-- Logs begin at Wed 2022-08-24 02:45:42 UTC, end at Wed 2022-08-24 04:06:08 UTC. -- Aug 24 03:27:29.038774 dv-cinder-854262-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:27:29.048378 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:27:29 2022] *** Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: nodename: dv-cinder-854262-1-iscsi Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: machine: x86_64 Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: clock source: unix Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: pcre jit disabled Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: detected number of CPU cores: 4 Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: current working directory: / Aug 24 03:27:29.049461 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:27:29.050269 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: your processes number limit is 47680 Aug 24 03:27:29.050269 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: your memory page size is 4096 bytes Aug 24 03:27:29.050269 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: detected max file descriptor number: 2048 Aug 24 03:27:29.050269 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: lock engine: pthread robust mutexes Aug 24 03:27:29.050269 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: thunder lock: enabled Aug 24 03:27:29.050269 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:27:29.050269 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:27:29.089055 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: Python main interpreter initialized at 0x55b8ca7a69c0 Aug 24 03:27:29.089055 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: python threads support enabled Aug 24 03:27:29.089055 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: your server socket listen backlog is limited to 100 connections Aug 24 03:27:29.089055 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:27:29.089391 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:27:29.089473 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: *** Operational MODE: preforking *** Aug 24 03:27:29.089709 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:27:29.089709 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: spawned uWSGI master process (pid: 105745) Aug 24 03:27:29.089894 dv-cinder-854262-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:27:29.090976 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: spawned uWSGI worker 1 (pid: 105746, cores: 1) Aug 24 03:27:29.090976 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: spawned uWSGI worker 2 (pid: 105747, cores: 1) Aug 24 03:27:29.090976 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:27:29.748306 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:27:29.760301 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:27:30.832893 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:27:30.832893 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: from cryptography.utils import int_from_bytes Aug 24 03:27:30.833544 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:27:30.833544 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: from cryptography.utils import int_from_bytes Aug 24 03:27:30.835076 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:27:30.835076 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: from cryptography.utils import int_from_bytes Aug 24 03:27:30.835503 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:27:30.835503 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: from cryptography.utils import int_from_bytes Aug 24 03:27:33.346554 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:27:33.347201 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:27:33.347338 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:27:33.347558 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:27:33.347985 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:27:33.348103 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:27:33.348213 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:27:33.348316 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.348423 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:27:33.348632 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.348744 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:27:33.348944 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:27:33.349100 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.349258 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.349428 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.349592 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.349748 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.349887 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.350000 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.350216 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.350339 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.350535 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.350657 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.350872 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.350976 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.351136 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.351264 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.351454 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.351549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.351783 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854262-1-iscsi {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.351876 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.352110 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.352223 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.352419 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.352527 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.352733 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.353342 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854262-1-iscsi {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.353586 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.353704 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.353893 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.353990 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.354233 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.354377 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.354546 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.354652 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.354852 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.355052 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.355173 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.355476 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.355586 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.355787 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.355992 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.356103 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.356472 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.356651 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.356760 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.356857 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.357001 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.357106 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.357261 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.357459 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.357554 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.357647 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.357843 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.357944 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.358169 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.358332 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.358651 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854262-1-iscsi {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.358776 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.358977 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.359259 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.359401 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.360705 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.360820 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.361000 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.361100 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854262-1-iscsi {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.361232 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.361330 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.361484 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.361608 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.361762 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.361908 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.362042 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.362152 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.362329 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.362428 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.362540 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.362639 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.362790 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.362936 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363086 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363086 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363323 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363492 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363600 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363697 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363791 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363886 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.363981 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.364086 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.364196 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.364306 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.364403 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.364539 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.364641 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.364791 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.364903 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.365100 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.365200 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.365430 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.365531 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.365752 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.365869 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.366081 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.366224 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.366364 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.366463 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.366614 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.366718 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.366937 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.367044 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.367262 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.367374 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.367572 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.367671 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.367864 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.367983 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.368140 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.368305 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.368442 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.368578 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.369353 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.369471 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.369662 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.369765 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.369974 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.370084 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.370308 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.370425 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.370625 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.370754 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.370940 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.371042 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.371253 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.371350 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.371564 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.371675 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.371875 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.371974 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.372199 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.372299 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.372516 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.372623 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.372827 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.372929 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.373143 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.373244 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.373471 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.373569 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.373780 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.373874 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.374101 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.374261 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.374446 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.374544 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.374754 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.374862 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.375064 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.375178 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.375372 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.375474 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.375693 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.375802 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.376027 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.376296 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.376426 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.376567 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.376715 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.376859 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.376997 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.377149 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.377291 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.377431 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.377573 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.377710 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.377865 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.377973 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.378066 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.378270 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.378375 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.378473 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.378653 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.378762 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.378960 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.379060 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.379268 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.379390 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.379574 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.379721 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.379881 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.379984 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.380192 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.380300 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.380497 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.380592 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.380802 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.380912 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.381113 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.381214 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.381419 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.381531 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.381731 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.381835 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.382037 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.382158 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.382370 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.382470 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.382677 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.382783 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.382983 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.383093 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.383321 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.383424 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.383603 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.383702 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.383914 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.384031 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.384248 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.384350 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.384556 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.384671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.384866 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.384976 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.385173 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.385285 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.385486 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.385586 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.385794 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.385901 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.386100 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.386234 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.386437 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.386547 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.386739 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.386848 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.387048 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.387145 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.387361 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.387451 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.387667 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.387765 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.387972 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.388066 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.388275 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.388362 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.388581 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.388681 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.388886 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.388979 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.389191 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.389278 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.389494 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.389635 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.389800 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.389900 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.390102 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.390205 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.390437 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.390533 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.390747 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.390880 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.391056 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.391156 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.391367 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.391455 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.391671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.391764 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.391992 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.392231 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.392336 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.392407 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.392622 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.392712 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.392935 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.393079 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.393246 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.393369 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.393572 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:27:33.393661 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.393920 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.394016 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.394266 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.394372 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.394585 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.394672 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.394902 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.395005 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.395232 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.395319 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.395546 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.395632 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.395859 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.395957 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.396172 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.396259 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.396492 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.396586 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.396815 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.396904 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.397134 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.397220 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.397453 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.397539 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.397772 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.397874 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.398091 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.398178 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.398469 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.398572 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.398752 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.398843 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.399074 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.399161 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.399399 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.399492 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.399761 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.399907 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.400061 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.400150 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.400387 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.400483 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.400724 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.400812 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.401052 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.401186 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.401367 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.401464 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.401693 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.401779 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.402008 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.402096 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.402346 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.402455 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.402672 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.402769 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.403010 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.403097 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.403324 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.403459 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.403638 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.403726 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.403949 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.404042 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.404269 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.404367 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.404582 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.404670 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.404895 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.404981 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.405208 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.405299 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.405524 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.405780 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.405867 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.405935 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.406144 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.406309 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.406522 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.406635 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.406799 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.406886 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.407113 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.407202 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.407427 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.407515 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.407739 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.407827 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.408048 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.408136 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.408354 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.408449 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.408661 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.408756 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.408972 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.409060 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.409276 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.409363 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.409583 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.409678 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.409912 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.410065 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.410220 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.410369 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.410540 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.410641 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.410849 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.410937 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.411429 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.411517 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.411743 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.411841 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.412052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.412145 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.412358 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.412444 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.412674 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.412771 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.412986 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.413083 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.413294 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.413381 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.413607 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.413701 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.413917 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.414004 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.414241 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.414330 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.414570 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.414667 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.414878 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.414966 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.415187 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.415275 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.416042 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.416139 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.416355 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.416441 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.416667 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.416762 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.416978 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.417066 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.417289 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.417375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.417607 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.417702 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.417920 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.418008 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.418254 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.418346 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.418572 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.418672 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.418891 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.418978 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.419204 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.419290 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.419527 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.419623 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.419844 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.419930 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.420160 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.420253 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.420466 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.420563 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.420778 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.420865 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.421085 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.421173 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.421392 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.421534 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.421696 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.421791 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.422011 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.422098 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.422350 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.422449 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.422656 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.422743 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.422960 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.423047 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.423266 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.423355 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.423569 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.423695 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.423876 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.423963 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.424203 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.424301 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.424489 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.424584 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.424791 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.424879 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.425096 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.425180 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.425424 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.425513 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.425735 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.425831 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.426041 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.426135 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.426374 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.426477 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.426685 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.426781 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.427033 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.427134 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.427343 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.427430 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.427660 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.427759 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.427998 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.428101 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.428283 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.429407 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.429685 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.429779 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.430486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.430576 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.430657 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.430736 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.430831 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.430924 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.432413 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.432520 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.432603 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.432696 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.432787 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.432869 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.432948 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433027 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433105 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433183 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433351 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433430 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433508 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433586 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433664 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433751 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433828 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433896 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.433961 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434039 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434217 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434299 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434390 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434478 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434565 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434654 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434735 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.434821 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.435022 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.435110 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.435334 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.435507 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.435654 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.435749 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.435966 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.436053 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.436286 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.436383 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.436595 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.436690 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.436919 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.437006 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.437228 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.437316 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.437546 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.437632 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.437850 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.437937 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.438164 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.438324 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.438513 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.438599 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.438829 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.438915 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.439148 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.439244 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.439516 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.439611 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.439776 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.439862 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.440086 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.440174 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.440397 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.440497 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.440710 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.440805 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.441018 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.441105 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.441324 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.441410 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.441633 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.441774 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.441956 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.442047 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.442288 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.442379 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.442603 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.442707 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.442903 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.442997 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.443215 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.443300 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.443521 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.443619 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.443825 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.443964 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.444128 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.444228 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.444435 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.444523 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.444753 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.444853 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.445064 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.445150 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.445374 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.445474 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.445680 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.445767 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.445996 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.446084 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.446353 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.446443 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.446720 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.446810 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.447030 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.447143 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.447355 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.447482 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.447642 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.447774 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.447947 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.448083 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.448292 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.448410 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.448604 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.448723 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.448910 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.449031 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.449227 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.449322 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.449550 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.449644 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.449861 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.449957 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.450240 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.450333 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.450513 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.450604 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.450825 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.450923 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.451148 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.451235 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.451463 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.451550 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.451779 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.451924 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.452092 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.452192 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.452405 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.452499 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.452717 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.452806 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.453030 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.453126 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.453341 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.453427 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.453653 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.453747 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.453965 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.454097 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.454300 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.454407 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.454607 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.454696 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.454919 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.455006 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.455236 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.455323 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.455553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.455824 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.455930 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.456163 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.456301 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.456552 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.456931 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.457065 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.457955 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.457955 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.459259 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.459427 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.459568 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.459721 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.459872 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.460010 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.460152 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.460298 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.460451 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.460701 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.460859 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.461004 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.461145 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.461285 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.461285 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.461549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.461690 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.461831 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.461972 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.462292 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.462439 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.462594 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.462594 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.462849 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.463003 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.463149 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.463277 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.463400 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.463588 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.463735 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.463876 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.464019 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.464379 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.464539 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.464696 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.464842 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.464985 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.465122 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.465276 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.465430 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.465585 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.465724 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.465864 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.466003 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.466161 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.466419 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.466557 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.466698 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.466846 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.466981 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.467129 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.467272 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.467422 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.467560 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.467696 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.467832 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.467990 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.468316 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.468523 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.468730 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.468892 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.469050 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.469194 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.469335 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.469483 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.469626 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.469765 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.469926 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.470072 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.470237 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.470367 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.470494 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.470649 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.470791 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.470953 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.471095 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.471254 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.471397 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.471564 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.471708 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.471853 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.471984 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.472125 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.472253 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.472393 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.472535 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.472680 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.472824 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.472979 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.473123 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.473279 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.473484 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.473636 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.473782 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.473950 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.474110 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.474354 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.474499 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.474640 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.474778 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.474917 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.475078 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.475217 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.475352 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.475495 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.475634 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.475773 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.475928 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.476085 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.476225 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.476367 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.476509 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.476661 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.476815 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.476955 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.477093 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.477241 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.477378 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.477512 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.477662 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.477804 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.478497 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.478641 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.478784 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.478784 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.479077 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.479077 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.479352 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.479490 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.479626 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.479777 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.479920 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.479920 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.480182 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.480323 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.480473 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.480629 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.480770 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.480910 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.481063 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.481202 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.481354 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.481505 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.481647 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.481647 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.481927 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.482071 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.482266 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.482412 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.482555 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.482555 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.482810 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.482955 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.483115 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.483268 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.483409 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.483537 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.483675 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.483814 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.483977 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.484118 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.484265 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.484420 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.484564 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.484709 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.484865 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.485011 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.485155 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.485291 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.485426 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.485584 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.485725 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.485872 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.486030 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.486171 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.486335 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.486500 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.486645 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.486800 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.486942 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.487095 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.487253 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.487253 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.487529 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.487670 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.487813 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.487957 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.488102 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.488257 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.488403 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.488548 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.488690 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.488690 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.488933 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.489073 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.489210 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.489334 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.489459 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.489581 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.489820 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.489945 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.490071 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.490312 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.490438 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.490565 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.490708 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.490843 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.490969 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.491091 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.491177 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.491294 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.491452 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.491603 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.491753 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.491879 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.492016 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.492168 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.492320 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.492649 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.492773 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.492911 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.493052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.493202 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.493362 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.493556 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494173 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494322 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494404 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494492 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494629 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494720 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494808 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494889 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.494967 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495044 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495125 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495199 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495278 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495278 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495409 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495499 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495499 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495632 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495717 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495797 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.495882 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.496013 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.496148 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.496327 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.496639 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.496733 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.496954 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.497259 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.497346 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.497566 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.497852 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.497938 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.498216 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.498448 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.498535 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.498829 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.499010 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.499136 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.499449 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.499579 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.499758 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.500135 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.500229 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.500506 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.500705 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.500822 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.501131 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.501266 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.501444 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.501757 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.502065 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.502151 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.502424 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.502657 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.502747 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.503144 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.503239 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.503461 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.503859 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.503963 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.504090 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.504347 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.504436 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.504691 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.504922 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.505013 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.505324 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.505497 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.505633 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.505941 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.506079 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.506269 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.506600 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.506687 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.506906 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.507233 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.507412 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.507658 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.507978 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.508071 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.508286 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.508545 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.508707 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.509024 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.509667 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.509876 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.510237 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.510412 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.510566 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.510788 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.510870 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.511175 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.511360 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.511492 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.511806 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.511948 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.512136 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.512468 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.512553 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.512786 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.513069 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.513165 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.513404 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.513631 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.513717 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.514053 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.514302 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.514441 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.514971 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.515560 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.515673 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.515746 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.515814 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.515814 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.516047 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.516148 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.516376 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.516656 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.516745 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.516983 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.517222 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.517368 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.517603 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.517920 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.518081 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.518252 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.518569 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.518685 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.518885 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.519160 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.519312 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.519499 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.519751 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.519844 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.520099 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.520325 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.520415 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.520723 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.520899 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.521051 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.521374 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.521464 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.521701 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.522015 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.522112 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.522350 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.522639 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.522726 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.522981 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.523256 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.523345 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.523584 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.523873 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.523960 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.524232 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.524463 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.524551 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.525419 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.525633 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.525757 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.526092 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.526256 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.526432 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.526774 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.526861 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.527109 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.527435 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.527523 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.527762 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.528005 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.528108 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.528390 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.528605 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.528709 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.528997 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.529099 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.529305 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.529434 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.529611 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.529919 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.530018 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.530253 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.530561 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.530649 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.530868 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.531012 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.531178 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.531342 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.531507 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.531667 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.531815 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.531996 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.532141 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.532321 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.532455 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.532642 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.532761 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.532978 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.533060 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.533298 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.533434 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.533622 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.533715 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.533942 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.534044 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.534294 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.534384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.534609 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.534698 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.534920 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.535014 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.535244 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.535340 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.535555 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.535687 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.535870 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.535957 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.536443 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.536543 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.536762 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.536850 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.537083 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.537329 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.537468 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.537611 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.537845 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.537934 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.538167 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.538321 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.538507 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.538618 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.543800 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.543913 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.543998 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544088 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544180 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544180 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544317 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544383 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544507 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544507 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544663 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544798 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544890 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.544971 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545051 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545137 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545226 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545307 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545386 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545465 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545531 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545609 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545685 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545753 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545819 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545900 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.545980 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546068 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546156 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546267 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546351 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546351 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546485 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546572 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546653 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546732 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546810 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546889 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.546975 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547134 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547217 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547296 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547457 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547550 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547754 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547867 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.547959 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548040 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548119 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548208 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548336 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548422 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548502 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548590 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548683 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548841 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.548978 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549111 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549246 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549336 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549431 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549508 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549595 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549664 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549730 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549795 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549875 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.549991 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550073 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550161 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550342 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550435 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550517 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550593 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550672 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550834 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.550973 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.551154 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.551297 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.551472 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.551787 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.551872 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.552105 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.552194 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.552430 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.552517 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.552751 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.552840 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.553118 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.553315 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.553443 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.553646 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.553765 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.553965 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.554099 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.554308 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.554435 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.554624 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.554764 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.554941 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.555031 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.555256 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.555346 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.555570 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.555659 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.555883 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.556002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.556226 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.556304 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.556539 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.556619 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.556870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.556948 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.557193 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.557269 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.557521 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.557745 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.557863 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.558104 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.558224 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.558450 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.558540 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.558785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.558870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.559120 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.559248 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.559441 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.559519 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.559755 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.559841 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.560086 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.560172 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.560398 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.560485 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.560710 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.560794 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.561026 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.561102 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.561342 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.561444 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.561712 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.561834 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.561969 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.562087 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.562303 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.562409 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.562621 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.562717 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.562932 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.563029 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.563246 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.563376 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.563558 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.563702 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.563886 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.563976 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.564197 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.564285 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.564510 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.564604 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.564823 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.564910 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.565139 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.565226 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.565447 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.565532 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.565757 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.566004 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.566101 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.566358 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.566449 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.566705 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.566797 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.567015 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.567123 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.567330 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.567456 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.567640 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.567729 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.567962 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.568051 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.568272 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.568360 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.568586 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.568663 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.568894 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.568990 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.569210 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.569297 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.569520 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.569606 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.569827 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.569913 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.570155 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.570339 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.570499 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.570597 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.570809 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.570898 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.571128 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.571214 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.571440 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.571540 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.572329 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.572528 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.572652 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.572890 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.573213 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.573308 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.573546 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.573633 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.573876 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.573960 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.574217 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.574367 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.574532 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.574628 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.574862 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.574993 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.575173 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.575265 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.575483 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.575569 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.575802 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.575888 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.576117 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.576240 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.576424 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.576519 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.576734 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.576822 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.577046 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.577133 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.577363 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.577449 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.577674 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.577774 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.577988 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.578075 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.578346 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.578452 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.578666 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.578750 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.578980 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.579063 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.579290 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.579366 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.579598 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.579684 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.579911 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.579994 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.580216 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.580291 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.580525 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.580610 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.580835 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.580911 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.581145 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.581235 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.581455 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.581534 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.581761 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.581840 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.582073 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.582158 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.582405 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.582485 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.582719 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.582796 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.583030 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.583114 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.583343 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.583431 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.583648 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.583723 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.583976 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.584054 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.584285 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.584414 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.584591 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.584685 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.584945 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.585040 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.585259 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.585347 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.585582 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.585668 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.585893 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.585980 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.586224 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.586306 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.586579 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.586657 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.586937 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.587056 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.587335 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.588139 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.588369 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.588513 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.588667 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.588765 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.588835 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.589592 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.589793 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.589978 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.590215 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.590353 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.590466 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.590590 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.590703 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.590810 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.590929 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.591044 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.591177 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.591309 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.591450 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.591592 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.591725 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.591867 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.592001 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.592134 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.592268 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.592404 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.592537 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.592666 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.592788 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.592902 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.593013 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.593136 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.593250 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.593388 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.593522 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.593642 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.593772 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.593917 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.594036 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.594157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.594345 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.594450 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.594564 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.594762 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.594887 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.595073 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.595193 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.595385 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.595547 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.595703 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.595848 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.596003 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.596146 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.596288 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.596508 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.596655 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.596807 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.596957 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.597099 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.597363 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.597516 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.597659 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.597799 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.597943 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.598092 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.598287 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.598438 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.598581 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.598727 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.598872 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.599005 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.599162 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.599298 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.599439 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.599564 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.599707 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.599843 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.599992 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.600133 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.600265 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.600403 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.600589 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.600744 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.600906 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.601055 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.601245 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.601399 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.601547 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.601707 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.601850 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.601986 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.602140 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.602409 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.602542 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.602696 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.602785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.602933 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.603118 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.603264 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.603449 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.603585 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.603783 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.603936 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.604085 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.604224 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.604412 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.604509 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.604735 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.604878 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.605055 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.605206 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.605360 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.605517 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.605659 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.605803 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.605945 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.606093 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.606276 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.606429 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.606636 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.606783 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.606927 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.607147 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.607306 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.607462 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.607597 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.607756 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.607850 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.607943 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.608025 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.608106 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.608315 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.608413 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.608619 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.608717 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.608925 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.609036 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.609230 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.609368 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.609535 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.609700 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.609845 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.610012 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.610151 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.610361 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.610518 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.610692 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.610831 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.611045 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.611135 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.611355 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.611446 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.611693 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.611771 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.612024 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.612107 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.612339 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.612492 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.612655 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.612743 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.612966 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.613050 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.613213 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:27:33.613320 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.613587 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.613912 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.614260 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.614582 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.614897 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.615227 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.615543 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.615853 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.616164 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.616473 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.616782 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.617093 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.617415 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.617747 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.618057 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.618422 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.618767 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.619091 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.619410 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.619722 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.620055 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.620365 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.620674 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.620985 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.621297 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.621607 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.621923 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.622255 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.622572 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.622894 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.623214 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.623538 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.623863 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.624180 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.624504 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.624831 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.625186 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.625503 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.625847 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.626173 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.626510 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.626823 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.627133 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:27:33.627376 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:27:33.768046 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO dbcounter [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Registered counter for database nova_api Aug 24 03:27:33.782105 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO dbcounter [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Registered counter for database nova_api Aug 24 03:27:33.790546 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_db.sqlalchemy.engines [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:27:33.797538 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writer thread running {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:27:33.808247 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_db.sqlalchemy.engines [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:27:33.815273 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writer thread running {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:27:33.854345 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.context [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8a7a57e-d52d-44b0-8338-b5be28221a4a(cell1) {{(pid=105747) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:27:33.858334 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:33.858765 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:33.860365 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:33.861103 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:33.861560 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:33.863596 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:33.865623 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO dbcounter [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Registered counter for database nova_cell0 Aug 24 03:27:33.872020 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO dbcounter [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Registered counter for database nova_cell1 Aug 24 03:27:33.872304 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.context [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8a7a57e-d52d-44b0-8338-b5be28221a4a(cell1) {{(pid=105746) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:27:33.878646 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_concurrency.lockutils [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:33.878646 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_concurrency.lockutils [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:33.878646 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_concurrency.lockutils [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:33.879182 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_concurrency.lockutils [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:33.879562 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_db.sqlalchemy.engines [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:27:33.879670 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_concurrency.lockutils [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:33.881737 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_concurrency.lockutils [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:33.881855 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_db.sqlalchemy.engines [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:27:33.883808 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO dbcounter [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Registered counter for database nova_cell0 Aug 24 03:27:33.887966 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writer thread running {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:27:33.889857 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writer thread running {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:27:33.890232 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO dbcounter [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Registered counter for database nova_cell1 Aug 24 03:27:33.899478 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_db.sqlalchemy.engines [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:27:33.901509 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_db.sqlalchemy.engines [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:27:33.908639 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writer thread running {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:27:33.908979 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writer thread running {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:27:34.036341 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO dbcounter [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Registered counter for database nova_cell0 Aug 24 03:27:34.045031 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_db.sqlalchemy.engines [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:27:34.049530 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writer thread running {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:27:34.054428 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO dbcounter [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Registered counter for database nova_cell0 Aug 24 03:27:34.063943 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG oslo_db.sqlalchemy.engines [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:27:34.068824 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writer thread running {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:27:34.392037 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: WARNING keystonemiddleware.auth_token [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:27:34.399396 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: WARNING keystonemiddleware.auth_token [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:27:34.405441 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: WARNING keystonemiddleware.auth_token [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:27:34.412955 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: WARNING keystonemiddleware.auth_token [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:27:34.744297 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: WARNING keystonemiddleware.auth_token [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:27:34.750363 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: WARNING keystonemiddleware.auth_token [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:27:34.753340 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: WARNING keystonemiddleware.auth_token [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:27:34.755647 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8ca7a69c0 pid: 105747 (default app) Aug 24 03:27:34.757771 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:34.758970 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] 10.222.0.91 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 Aug 24 03:27:34.760193 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: WARNING keystonemiddleware.auth_token [None req-deb350fc-7e6e-42cb-84e1-9638638639b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:27:34.760305 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 788 bytes} [Wed Aug 24 03:27:34 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:27:34.765264 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8ca7a69c0 pid: 105746 (default app) Aug 24 03:28:55.153846 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:55.155594 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002463 Aug 24 03:28:55.156313 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 2/2] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:28:55.169654 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writing DB stats nova_api:SELECT=3 {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:55.171560 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writing DB stats nova_cell0:SELECT=3 {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:55.172806 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writing DB stats nova_cell1:SELECT=3 {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:55.173966 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writing DB stats nova_cell0:SELECT=3 {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:56.139172 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-88e79134-2941-4237-a6ac-db31e3fe6214 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:56.172177 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-88e79134-2941-4237-a6ac-db31e3fe6214 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.008601 Aug 24 03:28:56.174400 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 1/3] 10.222.0.91 () {60 vars in 1292 bytes} [Wed Aug 24 03:28:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:28:58.556742 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:58.557753 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-af18b409-3054-43ec-b0c2-2c2306d5c59e None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 24 03:28:58.558356 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 3/4] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:28:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:28:59.099259 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-8a12a9b1-79ae-400d-9263-3741475d8514 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "ram": 256, "swap": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:59.120947 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:59.120947 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: warnings.warn(msg) Aug 24 03:28:59.152519 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-8a12a9b1-79ae-400d-9263-3741475d8514 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.587719 Aug 24 03:28:59.153720 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 2/5] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:28:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:59.391426 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-151ab239-ca1a-4e2f-81d3-6815e7456d04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:59.396179 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:59.396179 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: warnings.warn(msg) Aug 24 03:28:59.399826 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_api:SELECT=3 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.400902 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_cell1:SELECT=3 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.402222 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_cell0:SELECT=3 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.402402 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.467426 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-151ab239-ca1a-4e2f-81d3-6815e7456d04 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298047 Aug 24 03:28:59.468307 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 4/6] 10.222.0.91 () {64 vars in 1336 bytes} [Wed Aug 24 03:28:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:01.821423 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-8a12a9b1-79ae-400d-9263-3741475d8514 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:01.822603 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-8a12a9b1-79ae-400d-9263-3741475d8514 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 03:29:01.823347 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 3/7] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:02.485833 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-a216fac3-331c-4c40-8d67-a23a96844c7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:02.505842 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:02.505842 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: warnings.warn(msg) Aug 24 03:29:02.528122 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-a216fac3-331c-4c40-8d67-a23a96844c7e admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.698882 Aug 24 03:29:02.528792 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 5/8] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:02.542529 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-a80e5a3b-cc13-4979-8de3-6f1b8ee3a192 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:02.545895 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:29:02.545895 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: warnings.warn(msg) Aug 24 03:29:02.578866 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-a80e5a3b-cc13-4979-8de3-6f1b8ee3a192 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041125 Aug 24 03:29:02.586921 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 4/9] 10.222.0.91 () {64 vars in 1336 bytes} [Wed Aug 24 03:29:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:04.971585 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-a216fac3-331c-4c40-8d67-a23a96844c7e admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:04.972598 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-a216fac3-331c-4c40-8d67-a23a96844c7e admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 03:29:04.973009 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 6/10] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:05.381628 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-6be9c8ee-1633-49c9-bb02-a33ae6875dd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:05.401973 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-6be9c8ee-1633-49c9-bb02-a33ae6875dd3 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423033 Aug 24 03:29:05.402590 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 5/11] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:05.414929 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-d3a4111e-9da5-4c9c-ad49-dbed28dcb76f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:05.439278 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-d3a4111e-9da5-4c9c-ad49-dbed28dcb76f admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028280 Aug 24 03:29:05.439836 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 7/12] 10.222.0.91 () {64 vars in 1336 bytes} [Wed Aug 24 03:29:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:07.877967 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-6be9c8ee-1633-49c9-bb02-a33ae6875dd3 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:07.879006 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-6be9c8ee-1633-49c9-bb02-a33ae6875dd3 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 24 03:29:07.879403 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 6/13] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:08.401237 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-a61a5345-fd3b-4f7e-b9db-6c6fcc324ae9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G"}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:08.426656 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-a61a5345-fd3b-4f7e-b9db-6c6fcc324ae9 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541090 Aug 24 03:29:08.427538 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 8/14] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:29:08.440978 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-9bcfe858-1baf-4e81-9a7c-772ddcd13a3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:08.467464 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-9bcfe858-1baf-4e81-9a7c-772ddcd13a3c admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030566 Aug 24 03:29:08.468039 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 7/15] 10.222.0.91 () {64 vars in 1336 bytes} [Wed Aug 24 03:29:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:10.850115 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-a61a5345-fd3b-4f7e-b9db-6c6fcc324ae9 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:10.851341 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-a61a5345-fd3b-4f7e-b9db-6c6fcc324ae9 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 24 03:29:10.851836 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 9/16] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:11.315553 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-6f6edaf1-eba6-49ae-97f1-fb8b5d15c8f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "vcpus": 4, "swap": 0}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:11.335753 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-6f6edaf1-eba6-49ae-97f1-fb8b5d15c8f0 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477439 Aug 24 03:29:11.336938 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 8/17] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:29:11.349260 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-4e48191c-a2ab-4756-b2db-a24552276bae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:11.375531 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-4e48191c-a2ab-4756-b2db-a24552276bae admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029876 Aug 24 03:29:11.376333 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 10/18] 10.222.0.91 () {64 vars in 1336 bytes} [Wed Aug 24 03:29:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:13.777228 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-6f6edaf1-eba6-49ae-97f1-fb8b5d15c8f0 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:13.778314 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-6f6edaf1-eba6-49ae-97f1-fb8b5d15c8f0 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 24 03:29:13.778733 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 9/19] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:29:14.278798 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-15b36f91-75ba-4601-be02-6fd4ba4dda11 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:14.315739 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-15b36f91-75ba-4601-be02-6fd4ba4dda11 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.530338 Aug 24 03:29:14.316447 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 11/20] 10.222.0.91 () {60 vars in 1292 bytes} [Wed Aug 24 03:29:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:16.973053 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-6f6edaf1-eba6-49ae-97f1-fb8b5d15c8f0 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:16.974684 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-6f6edaf1-eba6-49ae-97f1-fb8b5d15c8f0 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002248 Aug 24 03:29:16.975323 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 10/21] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:17.497883 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-ab1547ed-e334-43e7-b36e-f141bfbf5a57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "disk": 1, "swap": 0, "id": "1"}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:17.524364 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-ab1547ed-e334-43e7-b36e-f141bfbf5a57 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.536398 Aug 24 03:29:17.524364 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 12/22] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:17.535597 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-d4c27bba-55bd-48ab-bcdb-45c8744d9a0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:17.567924 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-d4c27bba-55bd-48ab-bcdb-45c8744d9a0a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035536 Aug 24 03:29:17.568849 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 11/23] 10.222.0.91 () {64 vars in 1333 bytes} [Wed Aug 24 03:29:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:19.970071 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-ab1547ed-e334-43e7-b36e-f141bfbf5a57 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:19.971144 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-ab1547ed-e334-43e7-b36e-f141bfbf5a57 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 24 03:29:19.971565 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 13/24] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:20.354455 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-0d8e3271-5816-4f1f-89ff-8834f4d29182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:20.373358 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-0d8e3271-5816-4f1f-89ff-8834f4d29182 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.395096 Aug 24 03:29:20.373912 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 12/25] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:20.386619 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-aa59aa8a-152e-47ed-a5da-23707533d735 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:20.411487 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-aa59aa8a-152e-47ed-a5da-23707533d735 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029163 Aug 24 03:29:20.412060 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 14/26] 10.222.0.91 () {64 vars in 1333 bytes} [Wed Aug 24 03:29:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:22.809219 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-0d8e3271-5816-4f1f-89ff-8834f4d29182 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:22.810981 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-0d8e3271-5816-4f1f-89ff-8834f4d29182 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Aug 24 03:29:22.811599 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 13/27] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:23.279031 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-a5f50107-abce-4cad-940e-f6bfa42c8655 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "swap": 0}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:23.299680 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-a5f50107-abce-4cad-940e-f6bfa42c8655 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.481858 Aug 24 03:29:23.300975 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 15/28] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:29:23.322757 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-c117fce4-af72-4116-8da3-754628ccd502 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:23.351114 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-c117fce4-af72-4116-8da3-754628ccd502 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036701 Aug 24 03:29:23.352176 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 14/29] 10.222.0.91 () {64 vars in 1333 bytes} [Wed Aug 24 03:29:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:25.798812 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-a5f50107-abce-4cad-940e-f6bfa42c8655 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:25.800514 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-a5f50107-abce-4cad-940e-f6bfa42c8655 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 Aug 24 03:29:25.800917 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 16/30] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:26.272359 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-55764ce0-082b-4f05-b77e-a2a5c5e9453a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "id": "4"}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:26.278558 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:26.298492 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-55764ce0-082b-4f05-b77e-a2a5c5e9453a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.489115 Aug 24 03:29:26.299175 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 15/31] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:26.311490 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-04affb45-4b28-46c2-ab6c-be57a2a136eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:26.341936 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-04affb45-4b28-46c2-ab6c-be57a2a136eb admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034326 Aug 24 03:29:26.343121 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 17/32] 10.222.0.91 () {64 vars in 1333 bytes} [Wed Aug 24 03:29:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:28.765419 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-55764ce0-082b-4f05-b77e-a2a5c5e9453a admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:28.765419 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-55764ce0-082b-4f05-b77e-a2a5c5e9453a admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 03:29:28.765419 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 16/33] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:29:29.317133 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-f363d7cb-13c2-4403-9bbe-40e58b26e513 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:29.348160 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-f363d7cb-13c2-4403-9bbe-40e58b26e513 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.571392 Aug 24 03:29:29.348831 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 18/34] 10.222.0.91 () {64 vars in 1283 bytes} [Wed Aug 24 03:29:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:29.370163 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-5a79f49a-c5c3-4107-94a1-78436cb50f10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:29.398607 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-5a79f49a-c5c3-4107-94a1-78436cb50f10 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032746 Aug 24 03:29:29.400355 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 17/35] 10.222.0.91 () {64 vars in 1333 bytes} [Wed Aug 24 03:29:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:29:47.610639 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-f363d7cb-13c2-4403-9bbe-40e58b26e513 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:47.611655 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-f363d7cb-13c2-4403-9bbe-40e58b26e513 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 24 03:29:47.612092 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 19/36] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:29:47.622724 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:48.010037 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-1f243b29-766c-489f-a6e6-eabd9acdbd12 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:48.028378 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-1f243b29-766c-489f-a6e6-eabd9acdbd12 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410075 Aug 24 03:29:48.028951 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 18/37] 10.222.0.91 () {60 vars in 1292 bytes} [Wed Aug 24 03:29:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:49.082339 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-f363d7cb-13c2-4403-9bbe-40e58b26e513 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:49.083381 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-f363d7cb-13c2-4403-9bbe-40e58b26e513 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 24 03:29:49.083808 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 20/38] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:29:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:49.616288 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-d55edab8-72fb-469a-ad32-1424b1d6d766 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:49.622513 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.wsgi [None req-d55edab8-72fb-469a-ad32-1424b1d6d766 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-d55edab8-72fb-469a-ad32-1424b1d6d766 admin admin] Request method failure captured: Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Accept: application/json Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Accept-Encoding: gzip, deflate Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Connection: keep-alive Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Content-Length: 0 Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Host: 10.222.0.91 Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Openstack-Api-Version: compute 2.90 Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Openstack-System-Scope: None Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: User-Agent: python-novaclient Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Auth-Token: gAAAAABjBZssERdvZcwUDWbNp1dG6lAI5IeEtMd688Msttu8jOyT-j__B9RxjjKbbNCE-4PP5Lw-Z6fUHDJJFkxftBWUXTwLqlfcqFQpF63Q51J4g4ODQmpomNZIALZsgWI2nGHNS0lJt3Lz6t5fEiUkldPNB8vWwuiPz4Wko_nFDtUAv719NdM Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Domain-Id: None Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Domain-Name: None Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Identity-Status: Confirmed Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Is-Admin-Project: True Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Domain-Id: default Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Domain-Name: Default Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Name: admin Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Role: admin,reader,member Aug 24 03:29:49.625796 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Roles: admin,reader,member Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant: admin Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant-Name: admin Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User: admin Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Domain-Id: default Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Domain-Name: Default Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Id: 7d825b9d979b45a095dd6e2cabfe9971 Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Name: admin Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: method: > Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: exception: Flavor 42 could not be found. Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: action_args: {'id': '42'} Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:49.627486 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:49.628461 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.629711 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-d55edab8-72fb-469a-ad32-1424b1d6d766 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:49.630798 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-d55edab8-72fb-469a-ad32-1424b1d6d766 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405536 Aug 24 03:29:49.630798 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 19/39] 10.222.0.91 () {60 vars in 1190 bytes} [Wed Aug 24 03:29:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:29:49.637349 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-67c75013-6230-4fbf-8eac-07b730820d5d admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:49.641447 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:49.662799 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-67c75013-6230-4fbf-8eac-07b730820d5d admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029145 Aug 24 03:29:49.663374 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 21/40] 10.222.0.91 () {60 vars in 1210 bytes} [Wed Aug 24 03:29:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:49.673988 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-72118462-c0f2-4b15-9c82-e7b53a63d4d6 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:49.698642 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-72118462-c0f2-4b15-9c82-e7b53a63d4d6 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028120 Aug 24 03:29:49.699202 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 20/41] 10.222.0.91 () {60 vars in 1210 bytes} [Wed Aug 24 03:29:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:49.709430 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-10582d00-002d-4fd7-a105-b3029b0036ad admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:49.716202 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.wsgi [None req-10582d00-002d-4fd7-a105-b3029b0036ad admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-10582d00-002d-4fd7-a105-b3029b0036ad admin admin] Request method failure captured: Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Accept: application/json Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Accept-Encoding: gzip, deflate Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Connection: keep-alive Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Content-Length: 0 Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Host: 10.222.0.91 Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Openstack-Api-Version: compute 2.90 Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Openstack-System-Scope: None Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: User-Agent: python-novaclient Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Auth-Token: gAAAAABjBZssERdvZcwUDWbNp1dG6lAI5IeEtMd688Msttu8jOyT-j__B9RxjjKbbNCE-4PP5Lw-Z6fUHDJJFkxftBWUXTwLqlfcqFQpF63Q51J4g4ODQmpomNZIALZsgWI2nGHNS0lJt3Lz6t5fEiUkldPNB8vWwuiPz4Wko_nFDtUAv719NdM Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Domain-Id: None Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Domain-Name: None Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Identity-Status: Confirmed Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Is-Admin-Project: True Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Domain-Id: default Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Domain-Name: Default Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Name: admin Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Role: admin,reader,member Aug 24 03:29:49.721004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Roles: admin,reader,member Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant: admin Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant-Name: admin Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User: admin Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Domain-Id: default Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Domain-Name: Default Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Id: 7d825b9d979b45a095dd6e2cabfe9971 Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Name: admin Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: method: > Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: exception: Flavor 42 could not be found. Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: action_args: {'id': '42'} Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:49.722617 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:49.723549 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:49.724626 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-10582d00-002d-4fd7-a105-b3029b0036ad admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:49.725700 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-10582d00-002d-4fd7-a105-b3029b0036ad admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017108 Aug 24 03:29:49.725700 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 22/42] 10.222.0.91 () {60 vars in 1190 bytes} [Wed Aug 24 03:29:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:29:50.704477 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-72118462-c0f2-4b15-9c82-e7b53a63d4d6 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:50.705476 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-72118462-c0f2-4b15-9c82-e7b53a63d4d6 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 24 03:29:50.705869 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 21/43] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:29:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:51.237697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-4ff278c7-69fd-4352-a9e8-fa55e609377f admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:51.243252 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.wsgi [None req-4ff278c7-69fd-4352-a9e8-fa55e609377f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-4ff278c7-69fd-4352-a9e8-fa55e609377f admin admin] Request method failure captured: Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Accept: application/json Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Accept-Encoding: gzip, deflate Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Connection: keep-alive Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Content-Length: 0 Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Host: 10.222.0.91 Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Openstack-Api-Version: compute 2.90 Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Openstack-System-Scope: None Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: User-Agent: python-novaclient Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Auth-Token: gAAAAABjBZsuHsAxiu1cxijd5EFIteN5gbA2JAA9F1h0OEvIzay2BP0l9rgi1TFZn08G4v40oxZg71yBqnDKn8vQw_lUETyPODKuTDzhGxweYs53Q8i7Mn1x2ZiNs6YxxVjh6u6XGQit7eVWBAgja9_xU5MhD9YMtQGBXS6hBdBPp4B03zqqqeQ Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Domain-Id: None Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Domain-Name: None Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Identity-Status: Confirmed Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Is-Admin-Project: True Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Domain-Id: default Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Domain-Name: Default Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Name: admin Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Role: admin,reader,member Aug 24 03:29:51.244785 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Roles: admin,reader,member Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant: admin Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant-Name: admin Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User: admin Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Domain-Id: default Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Domain-Name: Default Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Id: 7d825b9d979b45a095dd6e2cabfe9971 Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Name: admin Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: method: > Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: exception: Flavor 84 could not be found. Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: action_args: {'id': '84'} Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:51.246384 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:51.247375 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.248697 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-4ff278c7-69fd-4352-a9e8-fa55e609377f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:51.250000 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-4ff278c7-69fd-4352-a9e8-fa55e609377f admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.402205 Aug 24 03:29:51.250000 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 23/44] 10.222.0.91 () {60 vars in 1190 bytes} [Wed Aug 24 03:29:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:29:51.256597 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-1267f4c3-98dc-499a-871d-89490723078b admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:51.271213 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-1267f4c3-98dc-499a-871d-89490723078b admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018805 Aug 24 03:29:51.271746 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 22/45] 10.222.0.91 () {60 vars in 1210 bytes} [Wed Aug 24 03:29:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:51.281877 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-d185361d-ff1e-43c2-88ed-033fad2cd410 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:51.299249 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-d185361d-ff1e-43c2-88ed-033fad2cd410 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021029 Aug 24 03:29:51.299778 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 24/46] 10.222.0.91 () {60 vars in 1210 bytes} [Wed Aug 24 03:29:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:51.309210 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-94788c63-279c-4a9d-a0d8-f4327e3974d0 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:51.314663 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.wsgi [None req-94788c63-279c-4a9d-a0d8-f4327e3974d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-94788c63-279c-4a9d-a0d8-f4327e3974d0 admin admin] Request method failure captured: Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Accept: application/json Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Accept-Encoding: gzip, deflate Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Connection: keep-alive Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Content-Length: 0 Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Host: 10.222.0.91 Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Openstack-Api-Version: compute 2.90 Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Openstack-System-Scope: None Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: User-Agent: python-novaclient Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Auth-Token: gAAAAABjBZsuHsAxiu1cxijd5EFIteN5gbA2JAA9F1h0OEvIzay2BP0l9rgi1TFZn08G4v40oxZg71yBqnDKn8vQw_lUETyPODKuTDzhGxweYs53Q8i7Mn1x2ZiNs6YxxVjh6u6XGQit7eVWBAgja9_xU5MhD9YMtQGBXS6hBdBPp4B03zqqqeQ Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Domain-Id: None Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Domain-Name: None Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Identity-Status: Confirmed Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Is-Admin-Project: True Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Domain-Id: default Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Domain-Name: Default Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Name: admin Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Role: admin,reader,member Aug 24 03:29:51.316157 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Roles: admin,reader,member Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant: admin Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant-Name: admin Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User: admin Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Domain-Id: default Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Domain-Name: Default Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Id: 7d825b9d979b45a095dd6e2cabfe9971 Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Name: admin Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: method: > Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: exception: Flavor 84 could not be found. Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: action_args: {'id': '84'} Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:51.317716 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:51.318617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:51.319870 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-94788c63-279c-4a9d-a0d8-f4327e3974d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:51.320938 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-94788c63-279c-4a9d-a0d8-f4327e3974d0 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011846 Aug 24 03:29:51.320938 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 23/47] 10.222.0.91 () {60 vars in 1190 bytes} [Wed Aug 24 03:29:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:29:52.280995 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-d185361d-ff1e-43c2-88ed-033fad2cd410 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:52.282004 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-d185361d-ff1e-43c2-88ed-033fad2cd410 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 03:29:52.282436 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 25/48] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:29:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:52.807081 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-aa68b5f1-41da-4857-87db-5a4485e446bb admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:52.813096 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.wsgi [None req-aa68b5f1-41da-4857-87db-5a4485e446bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-aa68b5f1-41da-4857-87db-5a4485e446bb admin admin] Request method failure captured: Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Accept: application/json Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Accept-Encoding: gzip, deflate Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Connection: keep-alive Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Content-Length: 0 Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Host: 10.222.0.91 Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Openstack-Api-Version: compute 2.90 Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Openstack-System-Scope: None Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: User-Agent: python-novaclient Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Auth-Token: gAAAAABjBZswOUnuhPa_mk-jfupL0gAUt3RRAfWz2UjC41sfxu26NAFmujkK64uJ80fpMKA-NdVh1QQFgjjEZzyuM8Z11--UWkne57DZYA8qtuWOnelZmS5Yzrt5JAmDuFzMprhaeYKano_Cn06AquFztZUeHOYWPK7dElyXXtPp6bJGyRbH6b4 Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Domain-Id: None Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Domain-Name: None Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Identity-Status: Confirmed Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Is-Admin-Project: True Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Domain-Id: default Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Domain-Name: Default Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Project-Name: admin Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Role: admin,reader,member Aug 24 03:29:52.814637 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Roles: admin,reader,member Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant: admin Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-Tenant-Name: admin Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User: admin Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Domain-Id: default Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Domain-Name: Default Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Id: 7d825b9d979b45a095dd6e2cabfe9971 Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: X-User-Name: admin Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: method: > Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: exception: Flavor 451 could not be found. Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: action_args: {'id': '451'} Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:52.816263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:52.817270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.818671 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-aa68b5f1-41da-4857-87db-5a4485e446bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:52.820006 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-aa68b5f1-41da-4857-87db-5a4485e446bb admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395883 Aug 24 03:29:52.820006 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 24/49] 10.222.0.91 () {60 vars in 1193 bytes} [Wed Aug 24 03:29:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:29:52.825470 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-961751f1-544f-4290-ad31-6a65a9eb9d9f admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:52.840735 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-961751f1-544f-4290-ad31-6a65a9eb9d9f admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018764 Aug 24 03:29:52.841386 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 26/50] 10.222.0.91 () {60 vars in 1210 bytes} [Wed Aug 24 03:29:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:29:52.850664 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:52.865946 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018778 Aug 24 03:29:52.866528 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 25/51] 10.222.0.91 () {60 vars in 1210 bytes} [Wed Aug 24 03:29:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:52.875781 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-3cd4e5b3-1b1c-4869-a11d-9f6b8502e5b4 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:52.881037 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.wsgi [None req-3cd4e5b3-1b1c-4869-a11d-9f6b8502e5b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-3cd4e5b3-1b1c-4869-a11d-9f6b8502e5b4 admin admin] Request method failure captured: Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Accept: application/json Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Accept-Encoding: gzip, deflate Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Connection: keep-alive Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Content-Length: 0 Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Host: 10.222.0.91 Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Openstack-Api-Version: compute 2.90 Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Openstack-System-Scope: None Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: User-Agent: python-novaclient Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Auth-Token: gAAAAABjBZswOUnuhPa_mk-jfupL0gAUt3RRAfWz2UjC41sfxu26NAFmujkK64uJ80fpMKA-NdVh1QQFgjjEZzyuM8Z11--UWkne57DZYA8qtuWOnelZmS5Yzrt5JAmDuFzMprhaeYKano_Cn06AquFztZUeHOYWPK7dElyXXtPp6bJGyRbH6b4 Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Domain-Id: None Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Domain-Name: None Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Identity-Status: Confirmed Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Is-Admin-Project: True Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Domain-Id: default Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Domain-Name: Default Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Project-Name: admin Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Role: admin,reader,member Aug 24 03:29:52.882553 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Roles: admin,reader,member Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/24a8303d4cc94c8ebcfdb44c0be112a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant: admin Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant-Id: 24a8303d4cc94c8ebcfdb44c0be112a5 Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-Tenant-Name: admin Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User: admin Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Domain-Id: default Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Domain-Name: Default Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Id: 7d825b9d979b45a095dd6e2cabfe9971 Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: X-User-Name: admin Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: method: > Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: exception: Flavor 451 could not be found. Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: action_args: {'id': '451'} Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:29:52.884119 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:52.885002 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: ERROR nova.api.openstack.wsgi Aug 24 03:29:52.886052 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-3cd4e5b3-1b1c-4869-a11d-9f6b8502e5b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:29:52.887114 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-3cd4e5b3-1b1c-4869-a11d-9f6b8502e5b4 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011700 Aug 24 03:29:52.887114 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 27/52] 10.222.0.91 () {60 vars in 1193 bytes} [Wed Aug 24 03:29:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:29:53.849196 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:53.850167 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 03:29:53.850599 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 26/53] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:29:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:54.377366 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-61dd4d3e-73d4-497f-adaa-85dbb87b32b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:54.396057 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-61dd4d3e-73d4-497f-adaa-85dbb87b32b4 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.407275 Aug 24 03:29:54.396593 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 28/54] 10.222.0.91 () {64 vars in 1235 bytes} [Wed Aug 24 03:29:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:55.373720 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:55.374768 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 03:29:55.375165 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 27/55] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:29:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:55.901436 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-8cddf211-35d0-47d6-8a00-2b8837cc1c9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:55.920235 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-8cddf211-35d0-47d6-8a00-2b8837cc1c9a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.405767 Aug 24 03:29:55.920790 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 29/56] 10.222.0.91 () {64 vars in 1235 bytes} [Wed Aug 24 03:29:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:56.910643 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:56.911633 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 24 03:29:56.912029 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 28/57] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:29:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:57.443842 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-2fc6ce03-4b3f-47e6-a473-e801197fc67d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:57.462067 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-2fc6ce03-4b3f-47e6-a473-e801197fc67d admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406467 Aug 24 03:29:57.462843 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 30/58] 10.222.0.91 () {64 vars in 1235 bytes} [Wed Aug 24 03:29:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:58.434131 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:58.435162 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 03:29:58.435585 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 29/59] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:29:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:58.964279 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-8265b216-505d-4a0f-b2d7-21e1ad0aba73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:58.982295 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-8265b216-505d-4a0f-b2d7-21e1ad0aba73 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409074 Aug 24 03:29:58.982847 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 31/60] 10.222.0.91 () {64 vars in 1235 bytes} [Wed Aug 24 03:29:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:59.950879 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:59.951871 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 24 03:29:59.952263 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 30/61] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:29:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:00.490091 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-e5795d44-6f5a-4066-a75f-0bacaf3cd17f admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:00.510605 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-e5795d44-6f5a-4066-a75f-0bacaf3cd17f admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.415997 Aug 24 03:30:00.511139 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 32/62] 10.222.0.91 () {60 vars in 1202 bytes} [Wed Aug 24 03:30:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:57.417899 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.419314 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-e60283c4-4243-4c9e-b5d5-42f70a67dea5 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001824 Aug 24 03:30:57.419894 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 31/63] 10.222.0.91 () {54 vars in 931 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:57.432093 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:57.871126 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-a0bf8ce7-3f39-4283-abac-1066e340e332 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.892257 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-a0bf8ce7-3f39-4283-abac-1066e340e332 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.465435 Aug 24 03:30:57.892809 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 33/64] 10.222.0.91 () {60 vars in 1292 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:30:57.914876 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG dbcounter [-] [105746] Writing DB stats nova_api:SELECT=14 {{(pid=105746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:57.921484 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-1bb87d55-3adb-44c7-bb7d-4ac4ffef6af0 admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.934967 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-1bb87d55-3adb-44c7-bb7d-4ac4ffef6af0 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021950 Aug 24 03:30:57.935879 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 32/65] 10.222.0.91 () {60 vars in 1283 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:57.949602 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-4921d863-1772-4d79-b1ab-2ba33c816481 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.958522 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-4921d863-1772-4d79-b1ab-2ba33c816481 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013839 Aug 24 03:30:57.958979 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 34/66] 10.222.0.91 () {60 vars in 1286 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:57.976595 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.987941 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016556 Aug 24 03:30:57.988635 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 33/67] 10.222.0.91 () {60 vars in 1286 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:58.003335 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-373b3e2e-1820-438a-b6c3-ca1b8acc54e4 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:58.013632 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-373b3e2e-1820-438a-b6c3-ca1b8acc54e4 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015688 Aug 24 03:30:58.014213 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 35/68] 10.222.0.91 () {60 vars in 1283 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:13.019617 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:13.020805 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Aug 24 03:34:13.021270 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 34/69] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:13.165551 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_api:SELECT=6 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:13.322718 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-5aafbd73-369e-4a70-aefe-df18ab268f2e admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:13.325047 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:34:13.325047 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: warnings.warn(msg) Aug 24 03:34:13.326152 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-5aafbd73-369e-4a70-aefe-df18ab268f2e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.326641 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-5aafbd73-369e-4a70-aefe-df18ab268f2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.327061 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-5aafbd73-369e-4a70-aefe-df18ab268f2e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.327756 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-5aafbd73-369e-4a70-aefe-df18ab268f2e admin admin] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.328192 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-5aafbd73-369e-4a70-aefe-df18ab268f2e admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.328598 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-5aafbd73-369e-4a70-aefe-df18ab268f2e admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.361895 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-5aafbd73-369e-4a70-aefe-df18ab268f2e admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201445 Aug 24 03:34:13.362473 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 36/70] 10.222.0.91 () {60 vars in 1193 bytes} [Wed Aug 24 03:34:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:14.201835 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:14.202877 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 03:34:14.203277 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 35/71] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:34:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:14.393470 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-e8bffc03-7638-497c-88e7-d48ba8a9db87 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:14.395879 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:34:14.395879 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: warnings.warn(msg) Aug 24 03:34:14.397023 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-e8bffc03-7638-497c-88e7-d48ba8a9db87 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.397507 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-e8bffc03-7638-497c-88e7-d48ba8a9db87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.397939 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-e8bffc03-7638-497c-88e7-d48ba8a9db87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.398710 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-e8bffc03-7638-497c-88e7-d48ba8a9db87 admin admin] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.399158 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-e8bffc03-7638-497c-88e7-d48ba8a9db87 admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.399575 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-e8bffc03-7638-497c-88e7-d48ba8a9db87 admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.419869 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-e8bffc03-7638-497c-88e7-d48ba8a9db87 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077196 Aug 24 03:34:14.420436 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 37/72] 10.222.0.91 () {60 vars in 1193 bytes} [Wed Aug 24 03:34:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:25.705027 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:25.706035 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 03:34:25.706472 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 36/73] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:34:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:25.854882 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_cell0:SELECT=4 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:25.855727 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_cell1:SELECT=4 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:25.856380 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_api:SELECT=8 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:25.910463 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-6803cbd1-c983-4a5e-8ce7-c0834b234dd5 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:25.912839 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:34:25.912839 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: warnings.warn(msg) Aug 24 03:34:25.913944 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6803cbd1-c983-4a5e-8ce7-c0834b234dd5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.914459 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6803cbd1-c983-4a5e-8ce7-c0834b234dd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.914884 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6803cbd1-c983-4a5e-8ce7-c0834b234dd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:25.915596 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6803cbd1-c983-4a5e-8ce7-c0834b234dd5 admin admin] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.916033 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6803cbd1-c983-4a5e-8ce7-c0834b234dd5 admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.916446 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6803cbd1-c983-4a5e-8ce7-c0834b234dd5 admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:25.936251 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-6803cbd1-c983-4a5e-8ce7-c0834b234dd5 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086880 Aug 24 03:34:25.936822 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 38/74] 10.222.0.91 () {60 vars in 1193 bytes} [Wed Aug 24 03:34:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:26.796210 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:26.797323 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 24 03:34:26.797719 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 37/75] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:27.003481 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-60d800b2-1512-4077-a17e-e2343efe0fd3 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:27.005832 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:34:27.005832 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: warnings.warn(msg) Aug 24 03:34:27.006957 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-60d800b2-1512-4077-a17e-e2343efe0fd3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.007430 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-60d800b2-1512-4077-a17e-e2343efe0fd3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.007852 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-60d800b2-1512-4077-a17e-e2343efe0fd3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.008622 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-60d800b2-1512-4077-a17e-e2343efe0fd3 admin admin] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.009068 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-60d800b2-1512-4077-a17e-e2343efe0fd3 admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.009480 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-60d800b2-1512-4077-a17e-e2343efe0fd3 admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.038221 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-60d800b2-1512-4077-a17e-e2343efe0fd3 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088811 Aug 24 03:34:27.038351 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 39/76] 10.222.0.91 () {60 vars in 1193 bytes} [Wed Aug 24 03:34:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:38.289787 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:38.290825 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 03:34:38.291234 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 38/77] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:38.441335 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_cell0:SELECT=4 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:38.442084 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_cell1:SELECT=4 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:38.443100 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG dbcounter [-] [105747] Writing DB stats nova_api:SELECT=8 {{(pid=105747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:38.504585 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-6d2cf1ce-3c40-4631-aa71-f39823a94956 admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:38.506977 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:34:38.506977 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: warnings.warn(msg) Aug 24 03:34:38.508070 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6d2cf1ce-3c40-4631-aa71-f39823a94956 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.508543 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6d2cf1ce-3c40-4631-aa71-f39823a94956 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.508963 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6d2cf1ce-3c40-4631-aa71-f39823a94956 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.509670 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6d2cf1ce-3c40-4631-aa71-f39823a94956 admin admin] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.510107 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6d2cf1ce-3c40-4631-aa71-f39823a94956 admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.510540 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-6d2cf1ce-3c40-4631-aa71-f39823a94956 admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.532829 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-6d2cf1ce-3c40-4631-aa71-f39823a94956 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.096011 Aug 24 03:34:38.533386 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 40/78] 10.222.0.91 () {60 vars in 1193 bytes} [Wed Aug 24 03:34:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:39.380053 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: DEBUG nova.api.openstack.wsgi [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] Calling method '>' {{(pid=105746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:39.381094 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: INFO nova.api.openstack.requestlog [None req-2faadb6d-bfea-4d5e-b9bd-f0ce534a619c admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 24 03:34:39.381497 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: [pid: 105746|app: 0|req: 39/79] 10.222.0.91 () {56 vars in 1074 bytes} [Wed Aug 24 03:34:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:39.575620 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG nova.api.openstack.wsgi [None req-c9834159-1b51-4f66-b096-19cbece351ec admin admin] Calling method '>' {{(pid=105747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:39.578015 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:34:39.578015 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: warnings.warn(msg) Aug 24 03:34:39.579165 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-c9834159-1b51-4f66-b096-19cbece351ec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:39.579639 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-c9834159-1b51-4f66-b096-19cbece351ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:39.580064 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-c9834159-1b51-4f66-b096-19cbece351ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:39.580769 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-c9834159-1b51-4f66-b096-19cbece351ec admin admin] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:39.581211 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-c9834159-1b51-4f66-b096-19cbece351ec admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:39.581622 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: DEBUG oslo_concurrency.lockutils [None req-c9834159-1b51-4f66-b096-19cbece351ec admin admin] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:39.603677 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: INFO nova.api.openstack.requestlog [None req-c9834159-1b51-4f66-b096-19cbece351ec admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082598 Aug 24 03:34:39.604247 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: [pid: 105747|app: 0|req: 41/80] 10.222.0.91 () {60 vars in 1193 bytes} [Wed Aug 24 03:34:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:41.143899 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: Wed Aug 24 03:35:41 2022 - graceful shutdown triggered... Aug 24 03:35:41.144114 dv-cinder-854262-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 03:35:41.144980 dv-cinder-854262-1-iscsi devstack@n-api.service[105747]: Gracefully killing worker 2 (pid: 105747)... Aug 24 03:35:41.145423 dv-cinder-854262-1-iscsi devstack@n-api.service[105746]: Gracefully killing worker 1 (pid: 105746)... Aug 24 03:35:42.146107 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: worker 1 buried after 1 seconds Aug 24 03:35:42.146759 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: worker 2 buried after 1 seconds Aug 24 03:35:42.146759 dv-cinder-854262-1-iscsi devstack@n-api.service[105745]: goodbye to uWSGI. Aug 24 03:35:42.147896 dv-cinder-854262-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 03:35:42.148777 dv-cinder-854262-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 03:35:42.151954 dv-cinder-854262-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:35:42.162084 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:35:42.164758 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:35:42 2022] *** Aug 24 03:35:42.164928 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:35:42.165061 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:35:42.165182 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: nodename: dv-cinder-854262-1-iscsi Aug 24 03:35:42.165295 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: machine: x86_64 Aug 24 03:35:42.165406 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: clock source: unix Aug 24 03:35:42.165531 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: pcre jit disabled Aug 24 03:35:42.165651 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: detected number of CPU cores: 4 Aug 24 03:35:42.165762 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: current working directory: / Aug 24 03:35:42.165879 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:35:42.165989 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: your processes number limit is 47680 Aug 24 03:35:42.166124 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: your memory page size is 4096 bytes Aug 24 03:35:42.166124 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: detected max file descriptor number: 2048 Aug 24 03:35:42.166124 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: lock engine: pthread robust mutexes Aug 24 03:35:42.166754 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: thunder lock: enabled Aug 24 03:35:42.166754 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:35:42.166754 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:35:42.207131 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: Python main interpreter initialized at 0x55570674c9c0 Aug 24 03:35:42.207131 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: python threads support enabled Aug 24 03:35:42.207131 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: your server socket listen backlog is limited to 100 connections Aug 24 03:35:42.207131 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:35:42.207740 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:35:42.207740 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: *** Operational MODE: preforking *** Aug 24 03:35:42.207997 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:35:42.207997 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: spawned uWSGI master process (pid: 127246) Aug 24 03:35:42.208087 dv-cinder-854262-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:35:42.208667 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: spawned uWSGI worker 1 (pid: 127259, cores: 1) Aug 24 03:35:42.209200 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: spawned uWSGI worker 2 (pid: 127260, cores: 1) Aug 24 03:35:42.209506 dv-cinder-854262-1-iscsi devstack@n-api.service[127246]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:35:42.925380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:35:42.983805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:35:44.130496 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:35:44.130496 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: from cryptography.utils import int_from_bytes Aug 24 03:35:44.131197 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:35:44.131197 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: from cryptography.utils import int_from_bytes Aug 24 03:35:44.221717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:35:44.221717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: from cryptography.utils import int_from_bytes Aug 24 03:35:44.222597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:35:44.222597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: from cryptography.utils import int_from_bytes Aug 24 03:35:46.852015 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:35:46.852996 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:35:46.852996 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:35:46.853319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:35:46.853642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:35:46.854055 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.854417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.854783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.855024 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.855510 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.855831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.856166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.856493 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.856846 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.858742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.858742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.858742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854262-1-iscsi {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.858742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.858742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.858742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.859288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.859288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.859548 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.859857 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.860357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.862251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.862251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.862251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.862251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.862251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.862989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.862989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.862989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.863378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.863558 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.863966 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854262-1-iscsi {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.864284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.864607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.864927 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.865329 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.865641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.865952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.866309 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.866636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.866995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.867944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.876378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.876378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.876378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.876378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.876378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.876378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.876378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.876378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.877555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.877555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.877555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.877555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.877555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.877555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.877555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.878453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.878453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.878453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.878453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.878453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.878453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.878453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.879633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.880284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.880284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.880452 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.880609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.881207 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.884423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.884423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.884423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.884423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.884423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.884423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.884423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.884423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.885634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.885634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.885634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.885634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.885634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.886159 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.886766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.886766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.887089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.887288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.887479 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.888077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.888077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.888480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.888919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.889250 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.889250 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.891980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.891980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.891980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.891980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.891980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.891980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.891980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.891980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.893416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.893416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.893416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.893416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.893416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.894201 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.894201 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.894201 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.894665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.894825 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.895038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.895345 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.895653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.895961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.899612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.899612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.899612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.899612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.899612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.899612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.899612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.899612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.901236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.901236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.901236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.901236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.901236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.902042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.902369 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.902901 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.903411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.903908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.905343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.905343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.905343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.905343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.905959 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.905959 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.906281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.906545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.906871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.907206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.907534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.907851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.908204 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.908560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.908873 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.909253 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.909529 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.909940 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.910366 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.910913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.911252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.911596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.911920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.912383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.912713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.913036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.913356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.913724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.914393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.914746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.915070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.915393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.916804 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.917145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.917477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.917804 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.918130 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.918478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.918795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.919109 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.919432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.919829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.920168 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.920506 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.920822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.922295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.922295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.922295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.922611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.922727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.923124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.923314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.923631 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.923942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.924272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.924587 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.924898 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.925226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.925535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.925843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.926171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.926585 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.926902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.927219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.927538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.927868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.928208 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.928526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.928871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.929206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.929682 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.930018 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.930380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.930702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.931011 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.931324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.931626 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.931934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.932242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.932555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.932860 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.933171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.933481 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.933787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.934088 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.935552 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.935552 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.935552 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.935552 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.936501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.936501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.936501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.936893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.937040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.937264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.937592 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.937909 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.938259 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.938574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.938889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.939204 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.939518 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.939842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.940157 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.940480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.940796 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.941120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.941432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.941758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.942067 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.942441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.942784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.943172 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.943440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.943764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.944146 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.944399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.944700 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.945542 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.946056 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.946453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.946728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.947038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.947559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.948097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.948544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.948885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.949237 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.949804 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.950393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.950938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.951331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.951657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.951984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.952318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.952716 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.953078 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.953426 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.953725 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.954037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.954391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.954712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.955090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.955325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.955636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.955953 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.956266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.956578 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.956883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.957199 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.957527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.957843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.958174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.958520 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.958833 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.959139 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.959464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.959782 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.960086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.960390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.960742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.961780 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.962105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.962435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.962759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.963091 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.963401 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.964033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.964033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.964326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.964635 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.964953 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.965267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.965826 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.966021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.966261 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.967080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.967080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.967366 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.967508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.967754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.968062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.968377 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.968701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.969406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.969960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.970252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.970391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.970702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.971632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.971632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.971943 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.972230 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.972375 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.972602 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.972904 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.973248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.973530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.973836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.974143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.974300 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:35:46.974792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.974929 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:35:46.975062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.975207 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:35:46.975349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.975349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.975614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:35:46.975748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.975881 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:35:46.976024 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.976158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.976314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.976452 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.976593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.976741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.976874 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.977015 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.977160 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.977318 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.977456 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.977634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.977780 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.977961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.978107 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.978336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.978475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.978650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.978789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.978930 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.979075 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.979232 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.979383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.979559 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854262-1-iscsi {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.979698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.979884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.980069 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.980224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.980373 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.980515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.980659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.980793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.980925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.981090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.981238 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.981414 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.981552 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.981721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.981860 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.982042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.982246 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.982401 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.982569 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.982708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.982880 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.983034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.983199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.983340 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.983540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.983685 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.983858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.984008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.984171 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.984317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.984474 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.984618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.984768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.984912 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.985076 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.985215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.985392 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.985538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.985703 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.985841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854262-1-iscsi {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.986007 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.986151 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.986465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.986701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.986866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.987011 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.987174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.987403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.987571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.987774 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.987899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.988023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.988138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.988251 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.988379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.988493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.988605 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.988718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.988865 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.988997 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.989169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.989300 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.989478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.989604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.989786 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.989910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.990097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.990256 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.990405 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.990548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.990721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.990859 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.991030 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.991233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.991378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.991521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.991710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.991859 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.992027 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.992377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.992521 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.992693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.992989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.993145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.993288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.994341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.994538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.994709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.994866 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.995038 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.995288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.995477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.995638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.995802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.996040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.996301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.996550 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.996793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.998409 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.998651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.998865 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.999050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.999254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.999434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:46.999641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:46.999817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.000019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.000237 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.000436 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.000620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.000795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.000986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.000986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.001349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.001566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.001763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.001960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.001960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.002415 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.002563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.002563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.002563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.002563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.002563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.002563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.003604 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.003795 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.003795 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.004223 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.004427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.004427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.005139 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.005500 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.005500 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.005986 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.006234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.006234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.006595 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.006803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.006803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.007188 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.007372 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.008108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.008301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.008301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.008797 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.008980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.009161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.009335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.009335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.009712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.009898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.009898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.010366 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.010538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.010717 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.010909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.010909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.011260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.011449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.011634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.011798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.011798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.012171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.012362 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.012535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.012718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.012718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.013036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.013228 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.013372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.013505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.013644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.013777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.013777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.014034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.014176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.014349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.014569 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.014569 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.014847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.015001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.015149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.015284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.015424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.015566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.015566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.015823 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.015962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.016110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.016249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.016389 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.016531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.016531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.016786 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.016927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.017059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.017189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.017321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.017450 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.017580 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.017720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.017720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.018017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.018161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.018330 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.018481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.018481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.018754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.018894 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.019033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.019165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.019302 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.019448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.019448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.019710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.019857 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.019995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.020138 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.020270 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.020439 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.020439 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.020696 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.020836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:35:47.021051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.021185 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.021316 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.021455 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.021589 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.021727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.021872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.022003 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.022003 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.022397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.022552 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.022552 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.022841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.024932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.025062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.025176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.025296 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.025422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.025544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.025665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.025665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.025885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.026974 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027093 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027093 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027548 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027780 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.027893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.028121 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.028259 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.028404 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.028547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.028680 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.028819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.028819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.029087 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.029227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.029360 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.029491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.029491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.029760 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.029894 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.030033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.030172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.030473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.030611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.030729 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.030849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.030971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.031084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.031202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.031324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.031438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.031557 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.031677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.031803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.031916 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.032037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.032037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.032247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.032367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.032570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.032727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.032955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.033077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.033280 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.033600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.033728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.033925 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.034643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.034821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.034971 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.035125 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.035288 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.035445 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.035592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.035739 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.035892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.036038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.036185 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.036339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.036486 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.036631 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.036775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.036930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.037077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.037255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.037410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.037556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.037709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.037863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.038019 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.038165 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.038388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.038534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.038679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.038944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.039210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.039210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.039662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.039662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.040079 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.040283 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.040450 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.040657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.040817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.040817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.041094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.041249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.041396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.041549 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.041549 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.041845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.041998 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.042158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.042356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.042639 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.042826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.042977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.043129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.043289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.043436 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.043589 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.043742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.043899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.044044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.044204 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.044374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.044819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.044975 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.045137 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.045302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.045457 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.045603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.045750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.045906 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.046098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.046396 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.046556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.046712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.046859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.047276 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.047422 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.047653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.047814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.047961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.048106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.048250 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.048402 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.048574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.048732 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.048881 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.049025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.049170 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.049324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.049477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.049631 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.049777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.049931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.050077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.050252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.050406 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.050561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.050752 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.050904 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.051051 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.051205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.051351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.051510 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.051757 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.051999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.052251 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.052422 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.052597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.052831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.053101 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.053356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.053608 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.053831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.054078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.054428 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.055132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.055400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.055654 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.055875 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.056100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.056331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.056553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.056783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.056783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.058030 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.058224 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.058382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.058529 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.058687 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.058844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.058999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.059147 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.059302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.059448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.059624 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.059772 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.059917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.059917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.060203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.060358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.060517 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.060663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.060868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.061028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.061028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.061028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.061454 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.061613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.061764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.061915 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.062077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.062077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.062397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.062546 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.062700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.062846 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.062999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.063145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.063304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.063304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.063601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.063747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.063900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.064055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.064201 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.064346 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.064501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.064654 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.064808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.065260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.065521 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.065683 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.065838 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.065995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.065995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.066319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.066468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.066614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.066767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.066767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.067052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.067207 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.067207 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.067506 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.067661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.067661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.067661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.068099 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.068254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.068254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.068595 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.068761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.068761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.069056 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.069203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.069348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.069502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.069502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.069804 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.069952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.069952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.070913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.071068 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.071068 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.071363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.071518 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.071673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.071819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.071819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.072115 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.072261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.072261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.072553 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.072699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.072699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.072998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.073155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.073155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.073432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.073584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.073730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.073889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.074036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.074227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.074379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.074531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.074691 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.074838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.074984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.075375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.075549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.075838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.075999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.076147 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.076147 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.076424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.076583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.076583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.076878 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.077082 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.077235 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.077390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.077390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.077688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.077843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.077996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.078142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.078333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.078581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.078744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.079064 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.079221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.079401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.079725 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.079885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.080046 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.080305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.080459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.080654 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.080822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.081045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.081220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.081377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.081532 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.081684 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.081831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.081985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.082132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.082357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.082515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.082668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.082822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.083125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.083289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.083437 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.083666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.084028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.084182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.084414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.084613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.084767 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.085220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.085550 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.086353 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.086615 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.086768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.086934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.087091 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.087449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.087617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.087836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.088078 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.088231 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.089078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.089259 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.089259 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.089556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.089556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.089860 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.090033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.090673 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.090837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.090984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.091199 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.091363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.091363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.091363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.091799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.091799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.092073 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.092376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.092764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.093027 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.093355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.093848 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.094025 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.096909 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.097108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.097108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.097423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.097582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.097746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.097903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.098057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.098238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.098478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.098645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.098800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.098947 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.099094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.099241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.099387 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.099542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.099690 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.099845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.099992 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.100146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.100317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.100317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.100611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.100758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.100903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.101050 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.101050 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.102050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.102234 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.102400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.102555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.102709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.103401 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.103561 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.103716 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.103862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.104008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.104163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.104311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.104459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.104663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.104663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.104955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105112 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105259 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.105574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.106587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.106587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.107198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.107360 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.107548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.107869 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.108201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.109263 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.109263 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.109578 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.109738 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.109894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.109894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.110218 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.110374 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.110530 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.110530 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.111608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.111608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.111922 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.111922 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.112209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.112354 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.112499 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.112652 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.112814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.112962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.113107 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.113260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.113260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.113657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.113830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.113993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.114148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.114148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.114504 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.114664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.114664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.114950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.115103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.115248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.115401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.115401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.115696 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.115867 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.115867 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.116154 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.116308 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.116468 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.116614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.116614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.117837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.118007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.118156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.118346 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.118346 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.118751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.118751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.119058 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.119220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.119220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.119498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.119643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.119797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.119951 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.120108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.120341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.120495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.120721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.120993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.121158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.121354 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.121556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.121759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.121997 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.122525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.122707 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.122996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.123160 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.123572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.123735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.123882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.124212 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.124369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.124706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.124859 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.125178 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.125340 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.128885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.129082 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.129254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.129415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.129576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.129734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.129898 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.130068 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.130248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.130403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.130558 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.130706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.130706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.130706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.131143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.131290 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.131443 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.131607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.131821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.131986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.132140 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.132295 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.132441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.132441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.133008 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.133156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.133156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.133448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.133620 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.133620 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.134017 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.134171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.134355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.134502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.134660 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.134815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.134962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.134962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.135254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.135407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.135566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.135720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.135873 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.136019 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.136190 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.136343 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.136498 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.136644 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.136789 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.136934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.137080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.137231 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.137386 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.137539 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.137684 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.137836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.137982 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.138149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.138333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.138499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.138877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.139255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.139255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.139255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.139692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.139837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.139837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.140123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.140269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.140269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.140574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.140727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.140883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.141029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.141029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.141314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.141468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.141621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.141767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.141767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.142119 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.142335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.142335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.142816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.143062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.143217 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.143374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.143374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.143650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.143794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.144051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.144205 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.144366 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.144521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.144667 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.144830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.144983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.145138 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.145296 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.145645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.145799 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.145954 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.146149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.146402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.146553 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.146709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.146855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.147012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.147166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.147325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.147480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.147626 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.147779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.147932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.148086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.149003 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.149175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.149521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.149673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.149826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.149999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.149999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.150311 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.150477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.150647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.150800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.150961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.151121 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.151274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.151425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.151585 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.151746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.151961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.152138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.152138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.152430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.152583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.152734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.152905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.153083 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.153335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.153335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.153637 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.153799 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.153953 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.154262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.154426 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.154579 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.154732 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.154898 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.155051 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.155209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.155369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.155521 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.155680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.155848 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.156009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.156171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.156336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.156495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.156655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.156655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.156960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.157119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.157119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.157416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.157583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.157736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.157895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.158055 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.158234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.158426 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.158590 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.158744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.158917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.159251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.159478 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.159850 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.160016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.160168 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.160319 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.160471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.160630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.160782 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.160959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.161112 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.161263 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.161263 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.161550 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.161709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.161709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.162077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.162321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.162482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.162633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.162794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.162966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.163120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.163282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.163548 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.163831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.164613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.164776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.164936 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.165103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.165265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.165505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.165660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.165660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.165968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.166123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.166312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.166479 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.166640 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.166792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.166951 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.166951 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.167239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.167405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.167566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.167718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.167890 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.168043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.168203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.168356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.168507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.168658 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.168816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.168976 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.169160 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.169498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.169685 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.170051 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.170277 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.170455 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.170455 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.170763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.170931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.171092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.171251 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.171251 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.171568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.172189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.172352 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.172506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.172666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.172839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.172993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:35:47.173753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.173753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.175125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.175125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.175125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.175125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.175125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.175125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.175125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.176201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.176201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.176201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.176643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.176805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.176985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.177304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.177623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.177938 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.178284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.178603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.178995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.179247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.180433 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.180688 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.181049 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.181379 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.181700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.182022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.182403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.182771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.183101 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.183414 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.183793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.184053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.184374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.184694 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.185012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.185339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.185651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.185967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.186422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.186619 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.186937 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.187264 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.187605 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.187930 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.188249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.188567 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.188888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.189443 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.189764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.190102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.190621 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.190932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.191264 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.191609 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.191921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.192232 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.192543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.192859 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.193197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.193487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.193811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.194125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.194464 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.194788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.195148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.196195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.196556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.196878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.197210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.197540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.197866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.198198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.198532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.198848 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.199164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.201245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.201245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.201245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.201245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.201245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.202043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.202043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.202529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.202529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.202849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.203027 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.203341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.203652 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.203970 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.204282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.204592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.205044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.206983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.206983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.206983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.206983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.206983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.206983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.206983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.208099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.208099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.208099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.208565 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.208565 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.209022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.209186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.209486 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.209802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.210120 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.211588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.211588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.212121 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.212468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.212794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.213145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.213484 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.213796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.214107 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.214446 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.214829 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.216419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.216419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.216419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.216419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.216419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.219383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.219383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.219383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.219383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.219383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.219383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.219383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.219383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.220588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.220588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.220588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.220588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.220588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.221906 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.221906 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.221906 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.221906 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.222758 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.222758 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.222758 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.223195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.223348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.223592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.224028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.224439 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.224670 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.224986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.225301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.225627 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.225957 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.226348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.227464 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.227661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.230588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.230588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.230588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.230588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.230588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.230588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.230588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.230588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.232199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.232199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.232199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.232199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.232199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.232199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.233224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.233224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.233224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.233224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.233814 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.233814 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.234111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.234567 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.234961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.235448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.236035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.236620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.237210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.237800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.238445 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.238897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.239386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.239739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.240070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.240407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.240734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.241070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.241392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.241779 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.242388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.242697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.242934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.243176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.243402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.243721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.244044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.244364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.244688 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.244992 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.245330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.245663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.245980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.246335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.246663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.247086 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.247310 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.247594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO dbcounter [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Registered counter for database nova_api Aug 24 03:35:47.247848 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.248109 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.248406 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.248884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.248884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.249360 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.249610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.249871 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.250121 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.250418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.250728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.251049 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.251383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.251714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.252775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.252775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.252775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.253737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.253737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.253737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.254551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.254551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.255127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.255127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:35:47.255127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:35:47.270863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_db.sqlalchemy.engines [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:35:47.280235 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writer thread running {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:35:47.341096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.context [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8a7a57e-d52d-44b0-8338-b5be28221a4a(cell1) {{(pid=127260) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:35:47.345657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.346143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.347817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.348596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.349060 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.351173 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.353870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO dbcounter [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Registered counter for database nova_cell0 Aug 24 03:35:47.358672 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO dbcounter [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Registered counter for database nova_cell1 Aug 24 03:35:47.366528 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_db.sqlalchemy.engines [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:35:47.368620 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_db.sqlalchemy.engines [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:35:47.374661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writer thread running {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:35:47.419615 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO dbcounter [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Registered counter for database nova_api Aug 24 03:35:47.439874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_db.sqlalchemy.engines [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:35:47.447574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writer thread running {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:35:47.505897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.context [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8a7a57e-d52d-44b0-8338-b5be28221a4a(cell1) {{(pid=127259) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:35:47.509814 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.510330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.512021 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.512776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.513233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.515288 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.517335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO dbcounter [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Registered counter for database nova_cell0 Aug 24 03:35:47.521870 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO dbcounter [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Registered counter for database nova_cell1 Aug 24 03:35:47.531495 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_db.sqlalchemy.engines [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:35:47.534037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_db.sqlalchemy.engines [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:35:47.538879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writer thread running {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:35:47.540093 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writer thread running {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:35:47.542918 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writer thread running {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:35:47.550096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO dbcounter [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Registered counter for database nova_cell0 Aug 24 03:35:47.557193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_db.sqlalchemy.engines [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:35:47.561835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writer thread running {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:35:47.695492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO dbcounter [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Registered counter for database nova_cell0 Aug 24 03:35:47.704896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_db.sqlalchemy.engines [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:35:47.709897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writer thread running {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:35:47.889740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: WARNING keystonemiddleware.auth_token [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:35:47.897096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: WARNING keystonemiddleware.auth_token [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:35:48.036747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: WARNING keystonemiddleware.auth_token [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:35:48.044868 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: WARNING keystonemiddleware.auth_token [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:35:48.272075 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: WARNING keystonemiddleware.auth_token [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:35:48.279177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: WARNING keystonemiddleware.auth_token [None req-3276661e-88eb-40fa-8145-01ec5c79b6b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:35:48.284919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55570674c9c0 pid: 127260 (default app) Aug 24 03:35:48.422752 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: WARNING keystonemiddleware.auth_token [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:35:48.428904 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: WARNING keystonemiddleware.auth_token [None req-58bb972c-b374-454f-9d19-15115c93de86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:35:48.435126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55570674c9c0 pid: 127259 (default app) Aug 24 03:36:26.271997 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:26.277057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:26.279436 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:26.283552 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:27.875939 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b06dcf6c-aecb-4447-88cb-ecde29bf052c tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Action: 'create', calling method: .version_select at 0x7f077d10c5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1220903436", "metadata": {"Type": "work"}}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b06dcf6c-aecb-4447-88cb-ecde29bf052c tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Request method failure captured: Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 122 Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZy6xhLGZpKUbruudZEYRhioG627L5c6-RkjaYY9DmCtgqx-nTquEJh8k5Dlnnz7jMdonS3yQbsKegFMAlBPDXPlDW07cZvckQbt4ekNMXwOv_9sBDqdl1SKJH5yBTmqURYIm6UOdag4Jjy5LgKZ3ikqBmd5PwW2sE6-_EGsOhxJqhE Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:36:27.886126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 5a87acbd9ba24431a280b9f67913dd57 Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1220903436", "metadata": {"Type": "work"}}} Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: Aug 24 03:36:27.889768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1220903436', 'metadata': {'Type': 'work'}}}} Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:27.890882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:36:27.893008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:36:27.894497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:36:27.894497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:27.894497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b06dcf6c-aecb-4447-88cb-ecde29bf052c tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:27.894497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b06dcf6c-aecb-4447-88cb-ecde29bf052c tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.638641 Aug 24 03:36:27.894497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 1/1] 10.222.0.91 () {60 vars in 1156 bytes} [Wed Aug 24 03:36:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1641 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:36:28.285434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fe9d9405-7bfc-400a-a275-592b7d8799eb tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Action: 'create', calling method: .version_select at 0x7f077d14caf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1130973129", "metadata": {"Type": "work"}}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fe9d9405-7bfc-400a-a275-592b7d8799eb tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Request method failure captured: Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 120 Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZy6xhLGZpKUbruudZEYRhioG627L5c6-RkjaYY9DmCtgqx-nTquEJh8k5Dlnnz7jMdonS3yQbsKegFMAlBPDXPlDW07cZvckQbt4ekNMXwOv_9sBDqdl1SKJH5yBTmqURYIm6UOdag4Jjy5LgKZ3ikqBmd5PwW2sE6-_EGsOhxJqhE Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:36:28.340158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 5a87acbd9ba24431a280b9f67913dd57 Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1130973129", "metadata": {"Type": "work"}}} Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: Aug 24 03:36:28.342001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1130973129', 'metadata': {'Type': 'work'}}}} Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi '0' Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:28.342850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:36:28.344173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:36:28.349280 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:36:28.349280 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.349280 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fe9d9405-7bfc-400a-a275-592b7d8799eb tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:28.349280 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fe9d9405-7bfc-400a-a275-592b7d8799eb tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.444075 Aug 24 03:36:28.354030 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8196b3fa-f423-46e9-9822-369a246ed879 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Action: 'create', calling method: .version_select at 0x7f077d10cdc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1330501689", "metadata": {"Type": "work"}}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:28.357606 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 1/2] 10.222.0.91 () {60 vars in 1156 bytes} [Wed Aug 24 03:36:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 463 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8196b3fa-f423-46e9-9822-369a246ed879 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Request method failure captured: Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 119 Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZy6xhLGZpKUbruudZEYRhioG627L5c6-RkjaYY9DmCtgqx-nTquEJh8k5Dlnnz7jMdonS3yQbsKegFMAlBPDXPlDW07cZvckQbt4ekNMXwOv_9sBDqdl1SKJH5yBTmqURYIm6UOdag4Jjy5LgKZ3ikqBmd5PwW2sE6-_EGsOhxJqhE Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:36:28.361955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 5a87acbd9ba24431a280b9f67913dd57 Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1330501689", "metadata": {"Type": "work"}}} Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: Aug 24 03:36:28.363621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1330501689', 'metadata': {'Type': 'work'}}}} Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi '' Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:28.364425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:36:28.365945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:36:28.367138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:36:28.367138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:28.367138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8196b3fa-f423-46e9-9822-369a246ed879 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:28.367138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8196b3fa-f423-46e9-9822-369a246ed879 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014169 Aug 24 03:36:28.367138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 2/3] 10.222.0.91 () {60 vars in 1156 bytes} [Wed Aug 24 03:36:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:36:28.401682 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d1210086-0d7d-4b73-af7f-0ca9882eac5f tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Calling method '.version_select at 0x7f077d14c040>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:28.507908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:28.508984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:28.510024 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:28.510775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:29.536961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ed0ac3e5-8002-4214-b0ee-48772f7f8e2e tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077d048280>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:29.915094 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-d1210086-0d7d-4b73-af7f-0ca9882eac5f tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] HTTP exception thrown: Volume tempest-invalid-209040890 could not be found. Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d1210086-0d7d-4b73-af7f-0ca9882eac5f tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Request method failure captured: Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-209040890 HTTP/1.1 Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZy6xhLGZpKUbruudZEYRhioG627L5c6-RkjaYY9DmCtgqx-nTquEJh8k5Dlnnz7jMdonS3yQbsKegFMAlBPDXPlDW07cZvckQbt4ekNMXwOv_9sBDqdl1SKJH5yBTmqURYIm6UOdag4Jjy5LgKZ3ikqBmd5PwW2sE6-_EGsOhxJqhE Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:36:29.919895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 5a87acbd9ba24431a280b9f67913dd57 Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Volume tempest-invalid-209040890 could not be found. Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': 'tempest-invalid-209040890'} Aug 24 03:36:29.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-209040890 could not be found. (HTTP 404) (Request-ID: req-8369b485-0c01-4dd0-a9ec-d109900c1bf4) Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:29.921844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:36:29.922862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-209040890 could not be found. Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:29.923695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-209040890 could not be found. Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-209040890 could not be found. Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d1210086-0d7d-4b73-af7f-0ca9882eac5f tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Returning 404 to user: Volume tempest-invalid-209040890 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d1210086-0d7d-4b73-af7f-0ca9882eac5f tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/tempest-invalid-209040890" status: 404 len: 98 microversion: 2.1 time: 1.549936 Aug 24 03:36:29.924540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 2/4] 10.222.0.91 () {58 vars in 1215 bytes} [Wed Aug 24 03:36:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-209040890 => generated 98 bytes in 1553 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:36:29.942099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8268f80a-8a75-4ea6-85c4-0cd712a3a6ec tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007513 Aug 24 03:36:29.943766 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 3/5] 10.222.0.91 () {58 vars in 1140 bytes} [Wed Aug 24 03:36:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 03:36:29.963510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-95b25f5a-496c-4fe9-adae-bff11c204e75 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009211 Aug 24 03:36:29.965010 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 4/6] 10.222.0.91 () {58 vars in 1137 bytes} [Wed Aug 24 03:36:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:36:29.981153 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ed0ac3e5-8002-4214-b0ee-48772f7f8e2e tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/facf8cbb-a95b-43f6-8ed6-dd4f0564e794" status: 200 len: 350 microversion: 2.1 time: 0.448214 Aug 24 03:36:29.985943 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-21ded305-fe32-4187-a42c-cb367e4117db tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Calling method '.version_select at 0x7f077cf2d4c0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:29.989162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 3/7] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:36:29 2022] GET /compute/v2.1/os-volumes/facf8cbb-a95b-43f6-8ed6-dd4f0564e794 => generated 350 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:30.092740 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-21ded305-fe32-4187-a42c-cb367e4117db tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] HTTP exception thrown: Volume bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 could not be found. Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-21ded305-fe32-4187-a42c-cb367e4117db tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Request method failure captured: Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/os-volumes/bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 HTTP/1.1 Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZy6xhLGZpKUbruudZEYRhioG627L5c6-RkjaYY9DmCtgqx-nTquEJh8k5Dlnnz7jMdonS3yQbsKegFMAlBPDXPlDW07cZvckQbt4ekNMXwOv_9sBDqdl1SKJH5yBTmqURYIm6UOdag4Jjy5LgKZ3ikqBmd5PwW2sE6-_EGsOhxJqhE Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:36:30.112146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 5a87acbd9ba24431a280b9f67913dd57 Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Volume bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 could not be found. Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': 'bae0a187-9a64-4781-bcf6-4dd3fddfc3f5'} Aug 24 03:36:30.113990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 could not be found. (HTTP 404) (Request-ID: req-8e67d7cb-e64f-45d4-bf34-f20fc9fd0c3a) Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:30.114990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:36:30.116330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 could not be found. Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:36:30.119078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 could not be found. Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 could not be found. Aug 24 03:36:30.121776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.125888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-21ded305-fe32-4187-a42c-cb367e4117db tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Returning 404 to user: Volume bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:30.127259 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-21ded305-fe32-4187-a42c-cb367e4117db tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/bae0a187-9a64-4781-bcf6-4dd3fddfc3f5" status: 404 len: 109 microversion: 2.1 time: 0.150287 Aug 24 03:36:30.128336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 5/8] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:36:29 2022] DELETE /compute/v2.1/os-volumes/bae0a187-9a64-4781-bcf6-4dd3fddfc3f5 => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:30.140798 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b8ad55ce-54b8-4efd-843c-0141fec418e1 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Calling method '.version_select at 0x7f077cf9baf0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:30.183200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-b8ad55ce-54b8-4efd-843c-0141fec418e1 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] HTTP exception thrown: Volume 43f6f73d-feb3-496a-b4c8-fba0858b0cf9 could not be found. Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b8ad55ce-54b8-4efd-843c-0141fec418e1 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Request method failure captured: Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/os-volumes/43f6f73d-feb3-496a-b4c8-fba0858b0cf9 HTTP/1.1 Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZy6xhLGZpKUbruudZEYRhioG627L5c6-RkjaYY9DmCtgqx-nTquEJh8k5Dlnnz7jMdonS3yQbsKegFMAlBPDXPlDW07cZvckQbt4ekNMXwOv_9sBDqdl1SKJH5yBTmqURYIm6UOdag4Jjy5LgKZ3ikqBmd5PwW2sE6-_EGsOhxJqhE Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:36:30.187766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/d1e90a027f97405bb3b955ed2c51b109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: d1e90a027f97405bb3b955ed2c51b109 Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesNegativeTest-2032010513 Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 5a87acbd9ba24431a280b9f67913dd57 Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesNegativeTest-2032010513-project Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Volume 43f6f73d-feb3-496a-b4c8-fba0858b0cf9 could not be found. Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '43f6f73d-feb3-496a-b4c8-fba0858b0cf9'} Aug 24 03:36:30.188828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43f6f73d-feb3-496a-b4c8-fba0858b0cf9 could not be found. (HTTP 404) (Request-ID: req-93b6ead2-22a2-48f4-958c-2f2888690b11) Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:30.189440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:36:30.190397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43f6f73d-feb3-496a-b4c8-fba0858b0cf9 could not be found. Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:36:30.191701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43f6f73d-feb3-496a-b4c8-fba0858b0cf9 could not be found. Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43f6f73d-feb3-496a-b4c8-fba0858b0cf9 could not be found. Aug 24 03:36:30.193660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:36:30.196485 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b8ad55ce-54b8-4efd-843c-0141fec418e1 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] Returning 404 to user: Volume 43f6f73d-feb3-496a-b4c8-fba0858b0cf9 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:30.197633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b8ad55ce-54b8-4efd-843c-0141fec418e1 tempest-VolumesNegativeTest-2032010513 tempest-VolumesNegativeTest-2032010513-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/43f6f73d-feb3-496a-b4c8-fba0858b0cf9" status: 404 len: 109 microversion: 2.1 time: 0.061473 Aug 24 03:36:30.198717 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 4/9] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:36:30 2022] GET /compute/v2.1/os-volumes/43f6f73d-feb3-496a-b4c8-fba0858b0cf9 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:31.871985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7278eda0-0cf4-416d-b231-ddce4f81e83b tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf81a60>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.964859 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7278eda0-0cf4-416d-b231-ddce4f81e83b tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/07a87754-6920-4093-b86a-6cf270848ad7" status: 200 len: 351 microversion: 2.1 time: 0.097350 Aug 24 03:36:31.965708 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 6/10] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:36:31 2022] GET /compute/v2.1/os-volumes/07a87754-6920-4093-b86a-6cf270848ad7 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:33.810870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-936a8386-042e-4d7b-bc30-1de04d53e1b7 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf7b160>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:33.904291 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-936a8386-042e-4d7b-bc30-1de04d53e1b7 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/0e49d805-1b0a-4a26-b62a-5e017dc85481" status: 200 len: 351 microversion: 2.1 time: 0.097839 Aug 24 03:36:33.905063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 5/11] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:36:33 2022] GET /compute/v2.1/os-volumes/0e49d805-1b0a-4a26-b62a-5e017dc85481 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:33.919598 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1df97150-19dd-48cf-9086-ee6268e39c95 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf2d790>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.126041 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1df97150-19dd-48cf-9086-ee6268e39c95 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.210350 Aug 24 03:36:34.126727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 7/12] 10.222.0.91 () {58 vars in 1134 bytes} [Wed Aug 24 03:36:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:34.141634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b0e41868-dd67-4b6e-96d5-d6fb3fc9f640 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf7b820>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.372783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b0e41868-dd67-4b6e-96d5-d6fb3fc9f640 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.234817 Aug 24 03:36:34.386851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2a4b62ec-6d70-4654-aaae-aa7cd0a3462a tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf339d0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.390693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 6/13] 10.222.0.91 () {58 vars in 1149 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:34.554802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2a4b62ec-6d70-4654-aaae-aa7cd0a3462a tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.171486 Aug 24 03:36:34.569039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-dd0993ae-db9b-4df7-9cac-6528a7475209 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf7b1f0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.570303 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 8/14] 10.222.0.91 () {58 vars in 1134 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:34.718561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-dd0993ae-db9b-4df7-9cac-6528a7475209 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.154068 Aug 24 03:36:34.719258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 7/15] 10.222.0.91 () {58 vars in 1167 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:34.732448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-124933cc-81ac-48d6-a0d9-7271b76c0216 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf33700>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.901519 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-124933cc-81ac-48d6-a0d9-7271b76c0216 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.172892 Aug 24 03:36:34.902375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 9/16] 10.222.0.91 () {58 vars in 1170 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:34.915855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8e331cb0-5c66-4de7-af2b-6d4054ba7a13 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf80af0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.159704 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8e331cb0-5c66-4de7-af2b-6d4054ba7a13 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.248133 Aug 24 03:36:35.160539 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 8/17] 10.222.0.91 () {58 vars in 1155 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:35.175515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7056a35a-982e-4da1-91a0-3cc209e6c2c7 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf2d670>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.461831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7056a35a-982e-4da1-91a0-3cc209e6c2c7 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.290306 Aug 24 03:36:35.463283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 10/18] 10.222.0.91 () {58 vars in 1188 bytes} [Wed Aug 24 03:36:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:35.476901 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7a02826a-45a9-4b0e-b7e9-ed447938d210 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] Calling method '.version_select at 0x7f077cf83d30>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.740653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7a02826a-45a9-4b0e-b7e9-ed447938d210 tempest-VolumesTestJSON-2083372846 tempest-VolumesTestJSON-2083372846-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.266905 Aug 24 03:36:35.742055 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 9/19] 10.222.0.91 () {58 vars in 1155 bytes} [Wed Aug 24 03:36:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:43.549213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-36b6bd17-5ede-4821-bad5-e83e997a4a51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'create', calling method: .version_select at 0x7f077cf81b80>, body: {"keypair": {"name": "tempest-keypair-1971087163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9nEurfYv6kcIVpvdOVXeDcj6G3CvpEPw1SmJNnZ6NQh6R8gWMBKgvfMuzRo3nh3DNt+/FLBnp8EsJ14/dY7j9yv48e9XsDoABTsWsljA5mYMarAGAIYnGDBmn5/SmIRA=="}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:43.691926 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-36b6bd17-5ede-4821-bad5-e83e997a4a51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Getting quotas for project 6f0007a8402e4889bc8ed99a507036e4. Resources: {'key_pairs'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:43.700261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-36b6bd17-5ede-4821-bad5-e83e997a4a51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Getting quotas for user 0b294c0072b740cc960bc53e1f806ffc and project 6f0007a8402e4889bc8ed99a507036e4. Resources: {'key_pairs'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:43.841785 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-36b6bd17-5ede-4821-bad5-e83e997a4a51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.798549 Aug 24 03:36:43.847545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 11/20] 10.222.0.91 () {62 vars in 1200 bytes} [Wed Aug 24 03:36:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 818 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:36:47.517720 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-eae1b1ef-c6ae-4ac6-a24a-03a3c50ee2fe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: .version_select at 0x7f077cf7b670>, body: {"keypair": {"name": "tempest-keypair-653821510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5VrDl+IXKE9SeGHRs9TeDY0t4tNkLrQoefGf1yFwumk5MraPEfEv0iv/jPUwmy7fu8fXLJ/uNfcwFRXfmZeIG2S0Fqw5/NYKvZrJfKtuvd6ZTa54yR+i2OZ50UIhDqCQ=="}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:47.672851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-eae1b1ef-c6ae-4ac6-a24a-03a3c50ee2fe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for project c7c94d613f6b440bae60fc442661c671. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:47.693639 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-eae1b1ef-c6ae-4ac6-a24a-03a3c50ee2fe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for user b1d9d5fd0db54ddf85e05c77dd7f6c89 and project c7c94d613f6b440bae60fc442661c671. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:47.877800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-eae1b1ef-c6ae-4ac6-a24a-03a3c50ee2fe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.938041 Aug 24 03:36:47.887587 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 10/21] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:36:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:50.241983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1847971685", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "networks": [{"uuid": "46e84500-1fc3-450d-9158-ede8809688b2"}]}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:50.500703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] validate_networks() for [('46e84500-1fc3-450d-9158-ede8809688b2', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:50.985405 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-585269894", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:51.290662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] validate_networks() for [('cbe77abb-36a6-4ffd-9ff5-0dda975dc89a', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:53.678531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:53.679419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:53.679557 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:53.679894 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:53.680403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:53.696805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.698367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.699984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.702784 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.703264 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.704929 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.777652 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Getting quotas for project 53aa6850ae4d44619cc27cef9dcadc61. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:53.792069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Getting quotas for user 7f1047b63c4148ca8073e3414ef84d28 and project 53aa6850ae4d44619cc27cef9dcadc61. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:53.832405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:53.862403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:54.042397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1a5ceeb3-ed62-4486-b4e1-ebe3f7da6991 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.363114 Aug 24 03:36:54.045397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 12/22] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:36:54.069959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1053025452", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "040cf074-35e6-4c0d-8efa-af5dafe3fbd5"}], "security_groups": [{"name": "tempest-securitygroup--1292403554"}], "key_name": "tempest-keypair-1971087163", "user_data": "}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:54.684084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] validate_networks() for [('040cf074-35e6-4c0d-8efa-af5dafe3fbd5', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:55.852919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:55.853860 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:55.855489 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:55.856418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:55.857108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:55.876449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.878563 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.884197 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.886741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.887990 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.889568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.967147 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Getting quotas for project 9494dfc650374d64bf4b5f46259a0171. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:55.978812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Getting quotas for user 76c0df49fa9342778a56eae098b2f2cd and project 9494dfc650374d64bf4b5f46259a0171. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:56.009212 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:56.014808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:56.015734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:56.016924 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:56.019332 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:56.020363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:56.025633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:56.068357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.071440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.072827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.075812 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.080340 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.081660 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.176459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Getting quotas for project 6f0007a8402e4889bc8ed99a507036e4. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:56.210104 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Getting quotas for user 0b294c0072b740cc960bc53e1f806ffc and project 6f0007a8402e4889bc8ed99a507036e4. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:56.215020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e3b090d6-5798-4a35-b2bc-36e1721e38a1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.459843 Aug 24 03:36:56.218729 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 11/23] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 5464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:36:56.227996 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-484b6311-ff39-48a5-bceb-a3013818e095 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:56.231114 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-484b6311-ff39-48a5-bceb-a3013818e095 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:56.307029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:56.324344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:56.524070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-484b6311-ff39-48a5-bceb-a3013818e095 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.576166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-484b6311-ff39-48a5-bceb-a3013818e095 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1215 microversion: 2.1 time: 0.355608 Aug 24 03:36:56.579945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 12/24] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1215 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:56.586289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-485925038", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "179f4006-1dcb-402a-823f-dec3eb79c3e6"}], "security_groups": [{"name": "tempest-securitygroup--938050403"}], "key_name": "tempest-keypair-653821510", "user_data": "}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:56.625129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ed7e2352-d526-4fad-9d51-2e925ca031fa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.577214 Aug 24 03:36:56.628477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 13/25] 10.222.0.91 () {62 vars in 1188 bytes} [Wed Aug 24 03:36:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2582 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:36:56.651105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4593eedf-d497-47e2-a2be-d3459eab6a6c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:56.653346 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4593eedf-d497-47e2-a2be-d3459eab6a6c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:56.919315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] validate_networks() for [('179f4006-1dcb-402a-823f-dec3eb79c3e6', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:56.976483 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4593eedf-d497-47e2-a2be-d3459eab6a6c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.006947 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4593eedf-d497-47e2-a2be-d3459eab6a6c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1221 microversion: 2.1 time: 0.376815 Aug 24 03:36:57.007727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 14/26] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1221 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:57.024219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-74ce0de9-f603-430d-b226-b1f173dc3210 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:57.025580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-74ce0de9-f603-430d-b226-b1f173dc3210 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:57.201469 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-74ce0de9-f603-430d-b226-b1f173dc3210 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.229425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-74ce0de9-f603-430d-b226-b1f173dc3210 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.242620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-74ce0de9-f603-430d-b226-b1f173dc3210 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.244768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-74ce0de9-f603-430d-b226-b1f173dc3210 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1282 microversion: 2.20 time: 0.235528 Aug 24 03:36:57.268545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 15/27] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:57 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1282 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:57.604308 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:57.605674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:57.632717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:57.635076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:57.637440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:57.641327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:57.642835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:57.645827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.490030 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.579799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-80b4b9d2-28e7-4dea-b2d1-f74929722183 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1267 microversion: 2.1 time: 0.981618 Aug 24 03:36:58.580808 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 16/28] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:57 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1267 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:58.706945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-107444581", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:59.020879 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] validate_networks() for [('cbe77abb-36a6-4ffd-9ff5-0dda975dc89a', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:37:00.072418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:37:00.073774 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:37:00.075017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:37:00.075957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:37:00.076913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:37:00.128320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.136698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.141754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.150560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.151899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.153031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.298437 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for project c7c94d613f6b440bae60fc442661c671. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:37:00.336097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for user b1d9d5fd0db54ddf85e05c77dd7f6c89 and project c7c94d613f6b440bae60fc442661c671. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:37:00.373979 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:37:00.392102 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:37:00.662669 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e7574c5f-de09-47b9-8eab-65447cf8806a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.074253 Aug 24 03:37:00.674718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 13/29] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 4094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:37:00.692029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:00.693667 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:00.715549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.716764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.717453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.718552 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.719398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.721553 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.461862 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.539086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.548350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.553383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8b5c9dc8-89c6-43b5-bb19-66d09b5c84a1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1340 microversion: 2.20 time: 1.876275 Aug 24 03:37:02.567564 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 14/30] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:00 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1340 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:02.597945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.603991 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.637322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.637908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.640808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.644517 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.647318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.648427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.560103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:37:03.560967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:37:03.561261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:37:03.562763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:37:03.565081 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:37:03.592868 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.594647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.595686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.602685 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.605910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.607363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.644383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Getting quotas for project 9494dfc650374d64bf4b5f46259a0171. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:37:03.649870 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Getting quotas for user 76c0df49fa9342778a56eae098b2f2cd and project 9494dfc650374d64bf4b5f46259a0171. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:37:03.664116 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:37:03.666737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:37:03.826293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1de97d20-3c21-45e9-8648-4b301e9787ae tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.244011 Aug 24 03:37:03.827201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 17/31] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 5246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:37:03.834924 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.836557 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.854065 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.860373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.861349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.862455 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.863896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.869614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.918283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.930785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e8b5663c-8725-42c3-808d-be8072c135ef tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1273 microversion: 2.1 time: 1.360476 Aug 24 03:37:03.937320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 15/32] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1273 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:03.965894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.966508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.991443 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.992424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.993066 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.995594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.998573 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.999227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.322135 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.344834 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c183d4c0-75a0-4e55-9e87-2d5580f27916 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1292 microversion: 2.1 time: 0.513821 Aug 24 03:37:04.373160 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 18/33] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1292 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:04.401664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fa8bda52-ee4e-4da3-82cc-c8781141cddd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.412026 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-fa8bda52-ee4e-4da3-82cc-c8781141cddd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.106510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fa8bda52-ee4e-4da3-82cc-c8781141cddd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.132986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fa8bda52-ee4e-4da3-82cc-c8781141cddd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1221 microversion: 2.1 time: 0.756765 Aug 24 03:37:05.147283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 19/34] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:04 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1221 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:05.176051 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.177975 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.203845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.204349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.210736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.214566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.217152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.217999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.447415 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.467420 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.471536 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.474352 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3af38a79-fd0a-4f46-931f-90acf95f8a38 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1340 microversion: 2.20 time: 1.525919 Aug 24 03:37:05.497569 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 16/35] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1340 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:05.512588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.513591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.545715 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.547095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.547716 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.548664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.549265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.549869 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.999231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.027104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a49572f7-9c9e-4744-b38e-357596b398ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1298 microversion: 2.1 time: 0.525793 Aug 24 03:37:06.033203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 17/36] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1298 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:06.168922 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.178731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.195170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.206854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.207654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.209130 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.210290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.211599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.782840 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.819397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-98552a30-9a69-45f4-9173-e2350a32b195 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 1.669698 Aug 24 03:37:06.822599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 20/37] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:06.872787 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.877943 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.909590 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.914922 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.917247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.922494 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.926341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.927636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.269304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:07.295424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-988fe45d-0097-4898-81f3-8b5f1228762f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1217 microversion: 2.1 time: 1.127113 Aug 24 03:37:07.299468 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 18/38] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1217 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:07.319344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:07.321052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:07.350163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.351571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.352596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.354211 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.355307 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.356266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.717733 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:07.765219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-48b8060c-0447-4c47-8fc3-35924285b864 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1298 microversion: 2.1 time: 0.453248 Aug 24 03:37:07.775163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 19/39] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:07 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1298 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:07.859770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:07.866872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:07.965831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.968465 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.974774 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.980812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.984557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.991153 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.819143 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.832601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.842586 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.843855 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e0b1be0d-3a37-46fe-8395-fa34fb3182d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 2.019928 Aug 24 03:37:08.854366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 21/40] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:08.861032 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:08.862058 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:08.883388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.886525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.887025 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.887774 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.888238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.890908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.328624 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.352087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f89b1c27-9625-423d-94fd-2739c21f0581 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1279 microversion: 2.1 time: 0.495647 Aug 24 03:37:09.352941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 22/41] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:08 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1279 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:09.383403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:09.384349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:09.408584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.409074 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.409516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.410883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.411379 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.411806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.818344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.845246 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e8474b3a-027e-4faf-a177-a95c24d86a04 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1298 microversion: 2.1 time: 0.488392 Aug 24 03:37:09.848130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 23/42] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:09 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1298 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:09.901595 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:09.917738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.933620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:09.950696 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c8df62cf-90bd-4a8b-850b-c8e99192513d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 2.109317 Aug 24 03:37:09.959215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 20/43] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:07 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:09.961148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.971106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.971928 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.972951 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.973663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.974432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.382027 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.384545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:10.398928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=4 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:10.402735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=18 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:10.407164 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.414925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.415797 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.416934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.418035 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.419264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.006510 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.068561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8828a051-62fb-4c14-9a19-2452606b752f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1279 microversion: 2.1 time: 0.687441 Aug 24 03:37:11.086364 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 21/44] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1279 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:11.088911 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.100042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.148914 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.155060 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.155883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.158227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.162282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.163171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.718695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.759545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.771240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:11.781236 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e8505845-3d4d-4bdf-82fe-89e0bdfd937d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 1.893442 Aug 24 03:37:11.809432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 24/45] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:09 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:11.829431 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:11.829999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:11.865277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.866166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.867066 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:11.868511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:11.869394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:11.870133 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.398836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:13.467119 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-55eb8ed5-fa45-48d5-b66d-5b3102d2aa23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 2.389206 Aug 24 03:37:13.493971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 22/46] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:11 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:13.530210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:13.531317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:13.619462 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.632879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.633697 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:13.634792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:13.635602 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:13.636174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:13.636522 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.334483 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:14.374796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-50dccae8-245a-4b58-9cb9-4837d1090540 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 2.557815 Aug 24 03:37:14.379044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 25/47] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:11 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:14.417534 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:14.419056 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:14.424448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:14.444532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.451666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.453059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.455864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.457788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.461652 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.949835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:14.961539 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d561b62d-a4d5-493d-9c1b-942c23298c7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1279 microversion: 2.1 time: 1.454329 Aug 24 03:37:14.963306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 23/48] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:13 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1279 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:14.971375 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:14.973271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:14.985091 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.985928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.986808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:14.988182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:14.989440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:14.990441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:15.128596 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=28 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:16.409659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.430882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.438784 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.444398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7abc8777-a89c-4455-92f0-86f292dbb37f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 2.063011 Aug 24 03:37:16.467686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 26/49] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:14 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:16.486460 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:16.504384 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:16.514240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.519295 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.520846 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.522014 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:16.523375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:16.531788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:16.886751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:16.931034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0845dc3b-f565-437e-9665-d2230e39da2d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 1.965390 Aug 24 03:37:16.961776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 24/50] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:14 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:17.072046 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.124273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-38844042-4064-46d9-8cda-423358ee26d6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.654932 Aug 24 03:37:17.131611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 27/51] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:16 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:17.165417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.165850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.176227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.176864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.177417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.178559 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.179857 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.180393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.223082 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-1855f25e-7b71-4d20-ae6a-48c3745579b1 req-b1f5528d-2d2d-4fb9-9ac8-6ee56214e0ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f3d229-1d44-43cd-83d5-7640dbcd03d0", "tag": "aa5bc36b-e721-496e-8812-48b7a0b6d9b9"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:17.260397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:17.266494 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1855f25e-7b71-4d20-ae6a-48c3745579b1 req-b1f5528d-2d2d-4fb9-9ac8-6ee56214e0ed service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.267391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1855f25e-7b71-4d20-ae6a-48c3745579b1 req-b1f5528d-2d2d-4fb9-9ac8-6ee56214e0ed service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.268877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1855f25e-7b71-4d20-ae6a-48c3745579b1 req-b1f5528d-2d2d-4fb9-9ac8-6ee56214e0ed service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.287953 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=71 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:17.299612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-1855f25e-7b71-4d20-ae6a-48c3745579b1 req-b1f5528d-2d2d-4fb9-9ac8-6ee56214e0ed service nova] Creating event network-changed:aa5bc36b-e721-496e-8812-48b7a0b6d9b9 for instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 on hv-cinder-85426 Aug 24 03:37:17.300382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1855f25e-7b71-4d20-ae6a-48c3745579b1 req-b1f5528d-2d2d-4fb9-9ac8-6ee56214e0ed service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:37:17.301020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1855f25e-7b71-4d20-ae6a-48c3745579b1 req-b1f5528d-2d2d-4fb9-9ac8-6ee56214e0ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=127260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:37:17.302525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.303144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.303735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.304752 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.305368 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.305950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.317360 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.compute.rpcapi [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:37:17.318629 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=127260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:37:17.388478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-93dfad33-bc09-485c-99f5-fc4e14ddb5b6 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391885 Aug 24 03:37:17.390953 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 25/52] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:17.443426 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:17.455172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-50e29a8a-8360-477a-82a3-1f77fa764465 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.318907 Aug 24 03:37:17.458890 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 28/53] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:17.485990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.489195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:17.511450 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.517118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.518205 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.520173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.522940 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.525215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.564800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-3596c78a-8ff7-4639-8a2b-5a604114910c req-303045c7-1c4b-4f2f-9fba-926bc7d3c2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88860171-756d-4701-a8e0-095fd12fa4e6", "tag": "c4edcf8c-59e5-415c-bc26-f08f91e47a56"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:17.585168 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-3596c78a-8ff7-4639-8a2b-5a604114910c req-303045c7-1c4b-4f2f-9fba-926bc7d3c2f5 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.586255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-3596c78a-8ff7-4639-8a2b-5a604114910c req-303045c7-1c4b-4f2f-9fba-926bc7d3c2f5 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.586909 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-3596c78a-8ff7-4639-8a2b-5a604114910c req-303045c7-1c4b-4f2f-9fba-926bc7d3c2f5 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.601709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-3596c78a-8ff7-4639-8a2b-5a604114910c req-303045c7-1c4b-4f2f-9fba-926bc7d3c2f5 service nova] Creating event network-changed:c4edcf8c-59e5-415c-bc26-f08f91e47a56 for instance 88860171-756d-4701-a8e0-095fd12fa4e6 on hv-cinder-85426 Aug 24 03:37:17.608198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-3596c78a-8ff7-4639-8a2b-5a604114910c req-303045c7-1c4b-4f2f-9fba-926bc7d3c2f5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213945 Aug 24 03:37:17.609497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 26/54] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:17.984784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:17.989703 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.003365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.007350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.008834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.011655 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.013026 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.015853 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.137657 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.171041 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.179658 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.187686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b58b0809-6162-410b-afdb-9cafbcc240eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.703231 Aug 24 03:37:18.198028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 29/55] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:18.212148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.216241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.240373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.241233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.242023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.243010 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.243843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.244622 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.358872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.369792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-47a41042-9b57-429e-abd1-9b3c382e9637 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.396592 Aug 24 03:37:18.371098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 27/56] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:17 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:18.498643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.500766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.517784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.518841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.531310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.532519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:18.533216 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:18.534249 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:18.665651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.700258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1fdbdbe2-1824-46b1-8b70-537506d36696 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.499620 Aug 24 03:37:18.715110 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 30/57] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:18.792851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.804688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d27800ed-18ec-49cc-af92-0378e2702b57 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.316475 Aug 24 03:37:18.805624 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 28/58] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:19.224950 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:19.226412 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:19.238429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.239339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.240248 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.241934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.242966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.243762 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.398936 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:19.400888 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:19.412730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.413785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.414587 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.415892 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.416563 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.417294 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.504471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.517529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.521619 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.523811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7d032dec-af3c-475f-bdfe-3fd4c4c077a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.308213 Aug 24 03:37:19.525087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 31/59] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:19 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:19.616351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-884cc9a1-add9-4f27-8e0f-9d42ae66637e req-27ce6183-17f1-409c-a49e-e3097f5ed64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e834164b-a670-4f2a-8322-0d968d8e6703", "tag": "0f8767fa-c35d-4362-bf07-a72ca2d4c311"}, {"name": "network-changed", "server_uuid": "1d87bb42-638e-4844-85c4-d34fdd734471", "tag": "4f6a3697-3452-41bc-9a68-6461e05b8d14"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:19.643467 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-884cc9a1-add9-4f27-8e0f-9d42ae66637e req-27ce6183-17f1-409c-a49e-e3097f5ed64d service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.645029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-884cc9a1-add9-4f27-8e0f-9d42ae66637e req-27ce6183-17f1-409c-a49e-e3097f5ed64d service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.645761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-884cc9a1-add9-4f27-8e0f-9d42ae66637e req-27ce6183-17f1-409c-a49e-e3097f5ed64d service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.672411 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-884cc9a1-add9-4f27-8e0f-9d42ae66637e req-27ce6183-17f1-409c-a49e-e3097f5ed64d service nova] Creating event network-changed:0f8767fa-c35d-4362-bf07-a72ca2d4c311 for instance e834164b-a670-4f2a-8322-0d968d8e6703 on hv-cinder-85426 Aug 24 03:37:19.673396 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-884cc9a1-add9-4f27-8e0f-9d42ae66637e req-27ce6183-17f1-409c-a49e-e3097f5ed64d service nova] Creating event network-changed:4f6a3697-3452-41bc-9a68-6461e05b8d14 for instance 1d87bb42-638e-4844-85c4-d34fdd734471 on hv-cinder-85426 Aug 24 03:37:19.674544 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-884cc9a1-add9-4f27-8e0f-9d42ae66637e req-27ce6183-17f1-409c-a49e-e3097f5ed64d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127259) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:37:19.675037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-884cc9a1-add9-4f27-8e0f-9d42ae66637e req-27ce6183-17f1-409c-a49e-e3097f5ed64d service nova] Acquired lock "compute-rpcapi-router" {{(pid=127259) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:37:19.677442 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.678298 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.679268 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.680748 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.681551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.682386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.684775 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.696985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3144eb3f-80a6-4a3b-b899-f6302bd5daf4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.304515 Aug 24 03:37:19.697809 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.compute.rpcapi [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:37:19.699106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] Releasing lock "compute-rpcapi-router" {{(pid=127259) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:37:19.727764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 29/60] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:19 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:19.735158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-e9a632be-764b-4846-b419-c972c8f36d09 req-90132564-160f-4a43-8e14-1522b1aed626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b8aee4-3b6d-456c-8b11-b1616f1447ce", "tag": "708a6aa3-e1e7-4841-a71a-401bf123e882"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:19.741798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-17a274e2-4fe0-421c-8c67-9cc3f9fb7682 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.136450 Aug 24 03:37:19.742695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 32/61] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:19.752201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:19.752991 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:19.754762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e9a632be-764b-4846-b419-c972c8f36d09 req-90132564-160f-4a43-8e14-1522b1aed626 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.755731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e9a632be-764b-4846-b419-c972c8f36d09 req-90132564-160f-4a43-8e14-1522b1aed626 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.757665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e9a632be-764b-4846-b419-c972c8f36d09 req-90132564-160f-4a43-8e14-1522b1aed626 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.765673 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.766170 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.766630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.767753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.768217 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.768642 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.775607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-e9a632be-764b-4846-b419-c972c8f36d09 req-90132564-160f-4a43-8e14-1522b1aed626 service nova] Creating event network-changed:708a6aa3-e1e7-4841-a71a-401bf123e882 for instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce on hv-cinder-85426 Aug 24 03:37:19.781794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-e9a632be-764b-4846-b419-c972c8f36d09 req-90132564-160f-4a43-8e14-1522b1aed626 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052104 Aug 24 03:37:19.784736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 30/62] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:19.838064 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:19.838963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:19.845957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.846524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.846964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.848508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.848977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.849757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.039172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.068916 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:20.076537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3942a2ad-3d07-4ecf-9086-4e1c43e855d2 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.328603 Aug 24 03:37:20.080399 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 33/63] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:19 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:20.101150 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.111606 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d2ed18e7-e5ee-4607-9804-340772e3e3f3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.279980 Aug 24 03:37:20.114915 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 31/64] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:19 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:20.567638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.570022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.587607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.589215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.592334 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.594580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.606166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.608239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.737400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.739363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.752665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.753478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.754042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.765014 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.770296 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.776452 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.853806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.865002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.866715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.868037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9c9ab42a-264a-4de8-b41a-3e026306c0ad tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.316234 Aug 24 03:37:20.868767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 34/65] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:20 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:21.107445 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.108442 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.109114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.122395 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.124837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-22e56511-e1ff-419a-94f0-7d3156913551 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.394976 Aug 24 03:37:21.125572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.126567 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.127653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.128179 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.129000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.131513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 32/66] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:20 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:21.159313 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.160931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.173949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.174960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.176394 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.177948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.178987 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.179910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.368292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.381991 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-63e18e27-b19c-470a-93b7-475e7adea59e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.284323 Aug 24 03:37:21.383092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 35/67] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:21.496549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.501532 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-66a280c3-fa6f-4bf5-8a67-200ad328b3dd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.349039 Aug 24 03:37:21.502551 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 33/68] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:21.905622 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.907999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.927470 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.928666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.929657 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.931181 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.932029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.932805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.155761 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.157057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.164854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.165710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.166682 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.168226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.169333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.170348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.183557 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.194439 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.196537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.198587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-238c7deb-0d5f-4392-89f3-931d271e1c20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.304542 Aug 24 03:37:22.199578 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 36/69] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:22.353344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.361903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b4a25acb-6bed-4d71-b7af-7785e6ac2e6f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.212917 Aug 24 03:37:22.362557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 34/70] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.420261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.421507 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.431125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.431697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.432199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.432993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.433510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.433991 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.529905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.531186 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.543043 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.544048 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.545103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.546047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.547054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.547824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.654021 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.669523 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bed7bc9d-136f-446f-8384-0beaf95fe33e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.256718 Aug 24 03:37:22.670709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 37/71] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.796227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.818522 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-327dce81-bbbb-4b26-a906-e637e2314dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.297112 Aug 24 03:37:22.819789 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 35/72] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:23.222140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.223630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.233319 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.233693 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.234438 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.235331 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.235891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.236728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.389404 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.390581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.402468 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.403910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.404995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.406527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.413477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.414888 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.474407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.504542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.507341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.509410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3543a8ec-15cf-4ad9-86a5-5abe1eeb348a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.290961 Aug 24 03:37:23.512029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 38/73] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:23.647755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.665888 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c4171744-0a4c-4b5c-8ccf-a4d828ac2fb1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.279545 Aug 24 03:37:23.667782 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 36/74] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:23.709631 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.710579 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.721802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.722664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.723608 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.724791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.726168 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.727566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.856920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.857989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.869503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.871157 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.872264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.873715 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.875158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.876171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.006746 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.023023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-47c1dbab-daa4-4e93-aa63-4b2db67bb674 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.319384 Aug 24 03:37:24.024653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 39/75] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:24.404663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.424082 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-54797ca7-c477-446e-a8cf-07e41f227d6d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.572452 Aug 24 03:37:24.427443 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 37/76] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:24.539324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.540369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:24.554023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.555228 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.556228 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.557644 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.558669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.559847 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.700844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:24.701993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:24.725724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.729584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.730949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.732964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:24.735820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:24.736654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.936650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.953789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.956083 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.960044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b914f214-5104-4d70-8e4f-5b31e64542dc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.428437 Aug 24 03:37:24.961131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 40/77] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:25.049761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.051361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:25.064064 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.065311 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.066409 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.067535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.069587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.070910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.328003 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.349065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-797e9cd3-58ee-4ec8-be03-1a337f193dfe tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.655387 Aug 24 03:37:25.350996 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 38/78] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:24 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:25.454566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.456240 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:25.464311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.465126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.465763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.466721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.467376 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.467995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.687318 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.702238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-462b2434-d5da-485c-b55a-8a65ad3db8ea tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.660042 Aug 24 03:37:25.703302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 41/79] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:26.013349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.015570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.033671 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.034491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.035113 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.035977 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.036580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.037149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.091709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.124417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-75efa859-1864-4bc1-9c3f-40ee35314787 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.673724 Aug 24 03:37:26.125584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 39/80] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:26.394526 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.400922 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.402537 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.409718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.410508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.411294 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.412389 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.412972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.413181 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.413663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.416967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.419875 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-37da8c99-b091-4de7-a076-4725f46b820e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.423870 Aug 24 03:37:26.421995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 42/81] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:26.735973 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.736713 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.739891 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.751143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cda12ce9-41ed-4036-8644-3dd80d3dc25b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.369767 Aug 24 03:37:26.753172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.770420 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.771279 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 40/82] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:26.771779 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.775183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.776321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.777399 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.059911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.076768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e6cde15c-e2d6-46e6-9359-da4c8514b310 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.345154 Aug 24 03:37:27.079876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 43/83] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:27.162065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.163187 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:27.173868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.174720 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.175482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.176673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.177617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.178419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.314755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:27.419120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.437619 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c564fb90-0f47-4151-9d84-390b6e082a27 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.283076 Aug 24 03:37:27.457431 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 41/84] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:27 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:27.462217 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.462217 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:27.467798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.471532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.473319 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.480167 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.480676 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.481124 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.721697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.735275 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.737526 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.740255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6f165536-74e5-4ecf-8264-a3cec7df8d1b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.286109 Aug 24 03:37:27.751817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 44/85] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:27 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:27.813396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.815975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:27.831908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.832825 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.833596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.834816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.836079 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.837669 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.030956 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.061844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e0f34a92-938b-4764-86bf-81cb066899a4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.256366 Aug 24 03:37:28.074748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 42/86] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:27 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:28.130402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:28.131733 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:28.139933 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.140367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.141023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.142130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.143105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.143864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.374769 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.389768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1baae0a2-4e61-4b09-90ec-9cdc24589617 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.266891 Aug 24 03:37:28.390978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 45/87] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:28 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:28.469688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:28.471384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:28.484809 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.485994 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.486991 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.489343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.490112 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.491099 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.515880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:28.748578 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.770069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:28.771219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:28.774928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-21f340a2-0814-4c67-843e-c8afc1255092 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.299000 Aug 24 03:37:28.776043 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 43/88] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:28 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:28.784350 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.786054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.787038 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.788511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.789555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.790554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.070700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.090304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.091896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.101988 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.112898 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.114213 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.116037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.119785 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.120923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.121714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.122762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.125306 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f39c5907-474f-47c4-adec-7f5528232e50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.361740 Aug 24 03:37:29.128328 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 46/89] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:28 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:29.351630 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.365959 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-281a1b47-0f75-4212-9dcf-28dcb4cc0a26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.282498 Aug 24 03:37:29.385900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 44/90] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:29.423914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.424854 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.431972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.432692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.433122 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.433989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.434484 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.434904 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.659221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:29.672191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8163c895-6028-45b8-adbb-f9624f2090ca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.251827 Aug 24 03:37:29.672973 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 47/91] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:29.802110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.804604 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.838845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.839882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.840738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.842295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.843429 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.844417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.153447 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:30.156049 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:30.159284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:30.188100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.189123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.189861 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.191812 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.192586 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.193290 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.736297 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.748531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-864bb524-803d-4896-8677-f3309a61bf8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.953926 Aug 24 03:37:30.749921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 45/92] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:30.756977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:30.757820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:30.774321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.774814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.775483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.776183 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:30.776630 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:30.777042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.505997 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.518133 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3ffb082b-00d9-4c0e-a43a-a6d00e123d09 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.765964 Aug 24 03:37:31.549256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 46/93] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:30 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:31.560182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:31.561305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:31.592604 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.594930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.595617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.599132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.599638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.606382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.753585 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.765823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.767540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.768685 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a4fae400-da7d-447d-a669-bf8aa4c21731 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 1.622907 Aug 24 03:37:31.774085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 48/94] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:30 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:31.785927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:31.786862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:31.800820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.804499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.822040 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.823142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.823649 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.829660 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.384150 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.426161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-46250cac-c9e1-4373-ae3e-b08557046d72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.649466 Aug 24 03:37:32.430606 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 49/95] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:31 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:32.559652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.585814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b04d5a7c-307a-458b-9971-7e827587788c tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 1.035350 Aug 24 03:37:32.588895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:32.590842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:32.605338 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.606196 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.607009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.608583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.609763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.610805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.612215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 47/96] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:31 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:32.663638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:32.809570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:32.810430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:32.818513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.818981 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.819419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.820132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.820574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.820987 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.928967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.938410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c822941d-795d-4cc9-aa8f-12543c56e009 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.390461 Aug 24 03:37:32.943108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 50/97] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:32 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:33.007987 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.023395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.026345 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.028365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-966de65a-20df-4164-a3e1-9e9b23b43eb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.223435 Aug 24 03:37:33.029487 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 48/98] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:32 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:33.452911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.454656 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.471428 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.472358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.473126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.474402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.475213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.475956 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.616498 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.617710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.628010 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.628963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.629777 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.630803 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.631390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.632126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.779949 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.794954 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-757303ad-790e-426a-8df8-91b3d02cf459 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.349749 Aug 24 03:37:33.799587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 51/99] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:33.833817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.850347 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d2943c73-c3d0-41d6-97cb-66c32046597e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.240863 Aug 24 03:37:33.852182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 49/100] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:33.975114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.975893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.985893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.986753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.987390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.989030 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.989638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.991916 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.066870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:34.072746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:34.089746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.090877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.099059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.100734 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.103213 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.109710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.335350 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.349808 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6da44401-3c23-43a3-b8df-d434f4cc7de4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.381523 Aug 24 03:37:34.364367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 52/101] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:34.409111 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.428665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.432788 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.435391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d5992c0d-5e8e-488d-af1a-65e437e2f97c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.381615 Aug 24 03:37:34.436483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 50/102] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:34 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:34.830871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:34.830871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:34.836934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.838067 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.839105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.840808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.859223 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.862440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.970593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-0846370c-4455-4b66-83bd-81ba39cbf450 req-32eb7e65-063d-4272-a439-99d03080fa7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f3d229-1d44-43cd-83d5-7640dbcd03d0", "name": "network-vif-plugged", "status": "completed", "tag": "aa5bc36b-e721-496e-8812-48b7a0b6d9b9"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:34.998842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-0846370c-4455-4b66-83bd-81ba39cbf450 req-32eb7e65-063d-4272-a439-99d03080fa7c service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.999511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-0846370c-4455-4b66-83bd-81ba39cbf450 req-32eb7e65-063d-4272-a439-99d03080fa7c service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.999755 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-0846370c-4455-4b66-83bd-81ba39cbf450 req-32eb7e65-063d-4272-a439-99d03080fa7c service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.029883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-0846370c-4455-4b66-83bd-81ba39cbf450 req-32eb7e65-063d-4272-a439-99d03080fa7c service nova] Creating event network-vif-plugged:aa5bc36b-e721-496e-8812-48b7a0b6d9b9 for instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 on hv-cinder-85426 Aug 24 03:37:35.041687 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-0846370c-4455-4b66-83bd-81ba39cbf450 req-32eb7e65-063d-4272-a439-99d03080fa7c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.519606 Aug 24 03:37:35.043383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 53/103] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:35.052097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.053350 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.069336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.070590 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.071481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.072506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.073201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.073835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.130913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.149627 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d162dd8f-f361-46cc-b3fb-3a3c0e39d387 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.331221 Aug 24 03:37:35.150956 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 51/104] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:34 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:35.294989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.306924 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-eb076ce8-c6b2-4a8d-8f96-78866e403452 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.261966 Aug 24 03:37:35.307921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 54/105] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:35.397776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.399800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.416019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.417302 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.418391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.419926 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.420928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.422560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.477876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:35.479813 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:35.493269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.494463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.496259 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.497934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:35.499085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:35.499793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:35.662656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.675971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bba5115d-f728-45eb-9aa2-2d7f4831f97f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.286031 Aug 24 03:37:35.699450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 52/106] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:35.779761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.796621 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.798477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:35.799547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-797957a3-c5a5-4468-8b99-78f2ccfb413b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.337179 Aug 24 03:37:35.801808 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 55/107] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:36.192395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:36.193365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:36.200277 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.200883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.201320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.202013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.202653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.202962 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.330948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:36.332853 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:36.345254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.348260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.350062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.351274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.352052 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.352913 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.444417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.462810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e99dd0c5-e584-4943-968f-a65950e2ef7c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.274706 Aug 24 03:37:36.475834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 53/108] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:36 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:36.539182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.560155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d7685337-f2c0-4ed6-8fd6-50c6654e9688 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.235344 Aug 24 03:37:36.581216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 56/109] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:36 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:36.704292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:36.704925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:36.713300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.714048 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.714932 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.715714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.716352 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.716781 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.838168 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:36.839811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:36.871761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.872556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.874249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.881114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.881643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.882203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.929304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.942016 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4282a53b-547a-426d-bc1c-7d7a05209962 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.240716 Aug 24 03:37:36.946750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 54/110] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:36 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:37.146123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.156343 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.162509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.163765 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fc421116-d40c-4bb2-bca7-5251d7c6d995 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.331187 Aug 24 03:37:37.164701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 57/111] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:36 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:37.499575 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.500501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.509651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.510815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.511899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.512817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.513570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.514226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.591512 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.592581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.605292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.608808 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.610464 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.611511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.611980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.612403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.731061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.742547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-06baee6b-c94f-4789-9022-6c5d7471c671 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.248129 Aug 24 03:37:37.743914 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 55/112] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:37.833157 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.842107 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4f9cc1dc-f768-4055-91ff-95b9ac1db388 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.256156 Aug 24 03:37:37.843273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 58/113] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:37.970852 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.971810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.989472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.990111 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.990491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.991206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.992002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.992576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.197105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.199095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.210172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.210784 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.211461 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.212858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.213619 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.214442 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.225648 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.247310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cb25d8d4-5c1c-4c84-900c-e5bdc7a46607 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.285079 Aug 24 03:37:38.248192 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 56/114] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:38.353218 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-ef5278fd-f9b0-4af2-82ef-22a5774bc1d2 req-9000401b-9ca4-497f-8f8c-3b8741a56ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d87bb42-638e-4844-85c4-d34fdd734471", "name": "network-vif-plugged", "status": "completed", "tag": "4f6a3697-3452-41bc-9a68-6461e05b8d14"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:38.365901 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-ef5278fd-f9b0-4af2-82ef-22a5774bc1d2 req-9000401b-9ca4-497f-8f8c-3b8741a56ba4 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.368108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-ef5278fd-f9b0-4af2-82ef-22a5774bc1d2 req-9000401b-9ca4-497f-8f8c-3b8741a56ba4 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.374930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-ef5278fd-f9b0-4af2-82ef-22a5774bc1d2 req-9000401b-9ca4-497f-8f8c-3b8741a56ba4 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.413562 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-ef5278fd-f9b0-4af2-82ef-22a5774bc1d2 req-9000401b-9ca4-497f-8f8c-3b8741a56ba4 service nova] Creating event network-vif-plugged:4f6a3697-3452-41bc-9a68-6461e05b8d14 for instance 1d87bb42-638e-4844-85c4-d34fdd734471 on hv-cinder-85426 Aug 24 03:37:38.423360 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-ef5278fd-f9b0-4af2-82ef-22a5774bc1d2 req-9000401b-9ca4-497f-8f8c-3b8741a56ba4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073764 Aug 24 03:37:38.424427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 57/115] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:37:38.504498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.513491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.515157 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.516347 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-35b6bcee-e869-4542-be63-8a3d3afd3dd0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.330748 Aug 24 03:37:38.530576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 59/116] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:38.773184 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.774019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.781707 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.782283 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.782940 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.784229 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.784905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.785539 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.868881 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.870941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.882033 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.883173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.884164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.885556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.886364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.888429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.101652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.114021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7966db2c-9802-48c2-b8c4-c1c500033bb0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.346408 Aug 24 03:37:39.114835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 58/117] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:39.287256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:39.289541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:39.302877 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.307845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.308553 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.309372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.310423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.311080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.311699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.322421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-13130c34-c98a-4800-8942-39c69068cfa4 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.458839 Aug 24 03:37:39.323496 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 60/118] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:39.544904 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:39.546510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:39.555524 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.556801 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.557760 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.559683 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.560364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.561180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.578690 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.587728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7e7dd648-946d-4524-a931-c9cbf08b84fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.308859 Aug 24 03:37:39.588759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 59/119] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:39 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:39.796287 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.808743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.811005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.812462 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a5409be2-4b7e-402a-bb09-bef5375d9b99 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.272822 Aug 24 03:37:39.813400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 61/120] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:39 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:40.140141 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:40.141713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:40.151407 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.152785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.153571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.155361 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.156059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.156768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.360458 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:40.362249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:40.388571 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.389061 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.389675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.390683 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.391290 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.392657 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.427867 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.431227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:40.439658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a6c6f3d9-63e7-42e2-81d5-eeba890f1b72 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.303463 Aug 24 03:37:40.453388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 60/121] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:40 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:40.618252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:40.619467 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:40.632214 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.632709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.633145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.633850 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.635262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.635812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.708764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.717298 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5e749bc1-1779-4316-b670-0a87921f7210 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.367394 Aug 24 03:37:40.726628 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 62/122] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:40 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:40.827471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.842339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:40.843825 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:40.870910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-fcdc2861-1ba5-4357-86da-defe57cfd8e0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.262316 Aug 24 03:37:40.872351 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 61/123] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:40 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:40.883199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.884088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.884818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.886010 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.886853 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.887612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.174338 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.209921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.219817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.220540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b5b22e6a-765d-420c-8329-419f5e9f5568 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.386510 Aug 24 03:37:41.221115 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 63/124] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:40 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:41.486150 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.489346 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.502231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.510001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.510659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.511852 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.512651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.513394 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.749286 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.751155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.774216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.774855 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.777165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.780018 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.780692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.782644 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.000520 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.011526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-605857d7-5dbc-495e-a1ab-a2b7e44476a7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.533002 Aug 24 03:37:42.015528 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 62/125] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:42.027440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:42.028053 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:42.041710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.048088 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.053617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.055557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.056369 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.057083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.069089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.083667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-04a3b057-ea4e-4eef-96e1-a3e86a630975 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.339931 Aug 24 03:37:42.084262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 64/126] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:42.250895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:42.251488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:42.259156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.259156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.259156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.259950 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.260415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.260843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.352989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.362005 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-fcfe33f8-09ed-4c7b-9144-bf101da6a460 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.345196 Aug 24 03:37:42.362778 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 63/127] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:42 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:42.461749 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.480352 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.482214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.483742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a205d719-0ebc-4cd8-9afd-7927301d6bc4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.236832 Aug 24 03:37:42.484782 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 65/128] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:42 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:43.031880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.032673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.039659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.040107 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.040645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.041217 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.041650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.042304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.110228 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.111896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.130493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.131830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.132959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.135209 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.136479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.137266 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.236430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.245786 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7e98a2ed-9877-45dd-a44b-7a973b9651c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.217655 Aug 24 03:37:43.247036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 64/129] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:43.293421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.310868 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-171e0cb1-8ca1-442e-8801-d1c6cc012063 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.207025 Aug 24 03:37:43.311451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 66/130] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:43.385811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.386627 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.404641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.405325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.405844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.406759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.407367 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.408120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.521674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.522961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.548791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.551392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.553411 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.555528 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.557606 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.559479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.743542 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:43.762849 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3f15afbd-ad08-45b8-bf9f-11fe58f3af73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.375269 Aug 24 03:37:43.765063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 65/131] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:43.905746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-2900adcc-06a5-414f-9aff-da90149e975b req-181542c1-fc21-4113-8bd4-6981098dbd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e834164b-a670-4f2a-8322-0d968d8e6703", "name": "network-vif-plugged", "status": "completed", "tag": "0f8767fa-c35d-4362-bf07-a72ca2d4c311"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:43.927586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2900adcc-06a5-414f-9aff-da90149e975b req-181542c1-fc21-4113-8bd4-6981098dbd84 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.928490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2900adcc-06a5-414f-9aff-da90149e975b req-181542c1-fc21-4113-8bd4-6981098dbd84 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.928942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2900adcc-06a5-414f-9aff-da90149e975b req-181542c1-fc21-4113-8bd4-6981098dbd84 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.954322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-2900adcc-06a5-414f-9aff-da90149e975b req-181542c1-fc21-4113-8bd4-6981098dbd84 service nova] Creating event network-vif-plugged:0f8767fa-c35d-4362-bf07-a72ca2d4c311 for instance e834164b-a670-4f2a-8322-0d968d8e6703 on hv-cinder-85426 Aug 24 03:37:43.967384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-2900adcc-06a5-414f-9aff-da90149e975b req-181542c1-fc21-4113-8bd4-6981098dbd84 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082300 Aug 24 03:37:43.968054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 66/132] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:37:44.045625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.049821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:44.076531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.092766 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.094344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a1f91ed6-800e-4628-a5b4-cd5a076245b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.581434 Aug 24 03:37:44.095542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 67/133] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:44.282228 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.284180 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.292974 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.294208 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.294885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.295908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.298374 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.299222 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.339545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.340210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.349781 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.350776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.351524 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.353352 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.354832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.355653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.578008 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.590168 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b5e8018f-8ae7-442b-8919-83b2c2075813 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.259445 Aug 24 03:37:44.590810 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 68/134] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:44.750896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.761276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5ec98de2-9221-4635-bb99-1e0824113155 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.488295 Aug 24 03:37:44.762631 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 67/135] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:44.803326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.804427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.813635 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=86 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:44.816237 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.818942 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.819645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.820620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.823361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.823996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.069918 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.088440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3824bf0f-7a71-4ff3-9845-fed2f32b46ed tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.288744 Aug 24 03:37:45.089642 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 69/136] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:45.144568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.145242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.160744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.161365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.161845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.162597 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.163040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.163670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.363633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.377113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.380468 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.382150 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-58159572-f8bd-4984-bfda-1294b05f9682 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.256411 Aug 24 03:37:45.383282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 68/137] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:45.615587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.617833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.627331 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.629019 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.629466 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.630171 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.630908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.631329 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.791586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.792127 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.804952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.805925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.806729 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.807609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.808235 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.808825 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.853914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.867214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-697832f7-6d4c-471f-b283-0cbaa62e805a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.258490 Aug 24 03:37:45.882124 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 70/138] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:46.061145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.071470 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1d4ab812-d58a-47cb-b5a3-1abe75665282 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.283878 Aug 24 03:37:46.072406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 69/139] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:46.119753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.120421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:46.131747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.132626 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.133601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.135060 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.135827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.136340 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.362316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.375170 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a107dc23-e616-4bf7-8ea2-640fb778488e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.263062 Aug 24 03:37:46.376077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 71/140] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:46.425776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.426699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:46.438349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.440349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.442258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.444016 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.445098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.445728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.631300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.647054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.649736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.651223 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0416813c-4226-433e-9cbc-7c8aa8ad382e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.244665 Aug 24 03:37:46.651797 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 70/141] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:46.905592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.906889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:46.916490 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.916980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.917517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.918247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.918745 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.919233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.088893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.097217 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.098738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.104795 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-00412a64-a760-4bfc-b920-6d0adb18fcca tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.205189 Aug 24 03:37:47.105834 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 72/142] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:47.109878 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.111835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.112782 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.113526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.113993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.114448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.271870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.280020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e57e9ddf-261c-4de7-b539-5ae38186d88d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.190032 Aug 24 03:37:47.280596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 71/143] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:47 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:47.404985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.405597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.412758 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.413244 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.413669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.414396 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.414845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.415267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.601938 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.613413 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c6039074-b0c9-4aa7-8d3a-7f15f332caad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.212146 Aug 24 03:37:47.614485 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 73/144] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:47 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:47.686525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.687609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.690394 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=94 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:47.697350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.698151 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.698736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.699599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.700244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.700749 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.896033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.904488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.905977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.907114 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-851f327e-e751-4235-ae99-94d78a3f5f20 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.225727 Aug 24 03:37:47.907663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 72/145] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:47 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:48.134022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.135289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.146267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.147136 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.147896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.149127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.149931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.150778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.302623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.303242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.309640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.310305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.310742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.311618 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.312275 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.312827 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.328674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.337841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2c5b46f1-f16e-4f52-9a61-bcd182e4ca1d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.213670 Aug 24 03:37:48.346026 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 74/146] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:48.496364 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.505312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8a77b867-8519-4eba-98ca-4e7a300a12da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.208007 Aug 24 03:37:48.506110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 73/147] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:48.636453 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.637294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.643498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.644550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.644987 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.645667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.646117 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.646566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.776294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.784074 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d3d02807-1325-44f1-a4f6-1f6ac7bfa5c9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.151500 Aug 24 03:37:48.784704 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 75/148] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:48.937969 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.939422 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.949642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.950121 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.950590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.951283 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.951731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.952154 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.080901 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.089050 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.090611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.091725 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-07803ce8-968a-4b11-8456-31d3164486bb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.163693 Aug 24 03:37:49.092288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 74/149] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:49.364287 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.364798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.370717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.371187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.371618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.372283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.372727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.373141 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.510394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.518363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-678ded84-fba5-4636-859b-a78c16af8b73 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.158509 Aug 24 03:37:49.519606 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 76/150] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:49.537056 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.537657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.543909 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.544452 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.544950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.545706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.546310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.547254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.691714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.699474 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4d028a84-4724-4b97-8174-6a821e03a948 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.166735 Aug 24 03:37:49.700318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 75/151] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:49.804996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.805724 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.811785 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.812283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.812706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.813385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.813827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.814270 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.949547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:49.957949 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-173ca18e-6333-4390-a766-bca544109a79 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.156705 Aug 24 03:37:49.958558 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 77/152] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:50.117507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.118121 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.124267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.124741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.125174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.125871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.126357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.126781 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.276910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:50.286016 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:50.287550 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:50.288664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a16e5dca-aba0-40be-b24e-ae319311cc13 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.175197 Aug 24 03:37:50.289234 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 76/153] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:50 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:50.544206 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.544750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.551532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.551866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.552300 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.553000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.553462 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.553885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.714942 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:50.722754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.723423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bed18a3c-b1f5-4520-95a6-940bd1a5c434 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.184326 Aug 24 03:37:50.723550 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.724005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 78/154] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:50 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:50.729808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.730420 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.730935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.731788 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.732308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.733026 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.887239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:50.899910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2cdd00c1-495b-4efc-a672-c8b753e7432a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.182500 Aug 24 03:37:50.900929 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 77/155] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:50 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:50.978689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.979292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.985363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.985834 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.986385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.987076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.988042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.988455 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.133810 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.142636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c5d2bd8e-04e2-4a10-9c15-2f9758fc4d9e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.167550 Aug 24 03:37:51.143095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 79/156] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:50 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:51.314281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:51.315293 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:51.324370 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.324854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.325296 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.325996 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.326483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.326901 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.329654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:51.467164 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.475903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.477417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.478560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d344c301-0818-475b-bb4c-c27339161f60 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.170888 Aug 24 03:37:51.479150 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 78/157] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:51 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:51.744816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:51.745425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:51.751629 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.752111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.752550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.753791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.754277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.754716 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.903164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.912284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e38172a9-46e2-4c6a-8a4b-c081da8419af tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.171215 Aug 24 03:37:51.912871 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 80/158] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:51 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:51.924311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:51.924837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:51.930944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.931418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.931843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.932523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.932976 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.933509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.076214 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.085035 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-066ba385-c114-4c37-9a05-287cf092dc7f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.164907 Aug 24 03:37:52.085621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 79/159] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:51 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:52.174424 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.175145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:52.181800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.182316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.182741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.183428 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.183883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.184293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.336409 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.344562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ec408e96-7641-4dfc-a8c4-168eccc6dd73 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.174534 Aug 24 03:37:52.345247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 81/160] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:52.507229 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.507932 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:52.514411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.515054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.515602 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.516399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.516854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.517278 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.661499 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.670010 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.671573 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.672960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-afe3e8c1-2ca4-4061-b2dd-d69ec78d5b66 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.170757 Aug 24 03:37:52.673732 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 80/161] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:52.933759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.935104 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:52.940722 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.941212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.941647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.942424 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.942931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.943348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.084989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.093102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-15212494-3798-434a-be03-f6edb68bee0a tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.163406 Aug 24 03:37:53.093674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 82/162] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:53.106277 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.107142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:53.113998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.114516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.114949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.115753 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.116206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.116719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.366517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.367130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:53.373274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.373776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.374903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.374903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.375332 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.375744 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.485689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.500945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-18ba6ff2-2051-46fa-9790-7d425ed34a64 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.398374 Aug 24 03:37:53.502218 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 81/163] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:53.671732 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.685576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0343676a-048c-4a14-a86b-bd443d75c02e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.321604 Aug 24 03:37:53.687012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 83/164] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:53.700188 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.701032 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:53.723982 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.724692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.727086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.728810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.731592 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.732608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.894953 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-165ac139-5341-457d-9682-8767498edb24 req-d5ee32b0-a1a6-4f3c-b50e-0068099988a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88860171-756d-4701-a8e0-095fd12fa4e6", "name": "network-vif-plugged", "status": "completed", "tag": "c4edcf8c-59e5-415c-bc26-f08f91e47a56"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:53.916384 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-165ac139-5341-457d-9682-8767498edb24 req-d5ee32b0-a1a6-4f3c-b50e-0068099988a2 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.918086 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-165ac139-5341-457d-9682-8767498edb24 req-d5ee32b0-a1a6-4f3c-b50e-0068099988a2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.918567 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-165ac139-5341-457d-9682-8767498edb24 req-d5ee32b0-a1a6-4f3c-b50e-0068099988a2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.955443 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-165ac139-5341-457d-9682-8767498edb24 req-d5ee32b0-a1a6-4f3c-b50e-0068099988a2 service nova] Creating event network-vif-plugged:c4edcf8c-59e5-415c-bc26-f08f91e47a56 for instance 88860171-756d-4701-a8e0-095fd12fa4e6 on hv-cinder-85426 Aug 24 03:37:53.962509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-165ac139-5341-457d-9682-8767498edb24 req-d5ee32b0-a1a6-4f3c-b50e-0068099988a2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074882 Aug 24 03:37:53.967067 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 84/165] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:37:54.099057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.110299 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.111774 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.113122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d27bdfe2-aa13-4fd2-ac0a-a7c5616020e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.418763 Aug 24 03:37:54.113505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 82/166] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:54.117337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:54.118317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:54.125484 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.126233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.126838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.127528 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.128278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.128768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.133145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:54.266098 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.274229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-88a9a7a9-bf01-4e0b-ace9-fbb7fb59f1ab tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.162810 Aug 24 03:37:54.274802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 85/167] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:54 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:54.535251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:54.535896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:54.542142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.542681 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.543122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.543885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.544272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.544695 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.684393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.692898 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-78feca16-bd4c-4d61-9703-c94c2c17394a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.161478 Aug 24 03:37:54.693491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 83/168] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:54 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:54.707896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:54.708505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:54.714742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.715229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.715667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.716400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.716850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.717277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.861545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.869817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-cd1131f3-ba67-4dea-86a3-cf7f2c14072e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.166381 Aug 24 03:37:54.870430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 86/169] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:54 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:55.135747 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.136356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.143465 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.143963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.144629 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.145728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.146395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.146862 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.295872 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.296662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.303379 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.303866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.304291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.304979 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.305423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.305839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.305954 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.315139 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.317009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.318199 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-047abb30-eb0d-42c4-905a-63dcebb8c6c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.186602 Aug 24 03:37:55.318765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 84/170] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:55.440936 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.449345 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f6aa70dc-889e-4b1a-a546-06bf894cc3b9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.157264 Aug 24 03:37:55.450493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 87/171] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:55.713672 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.714516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.721611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.722114 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.722693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.723538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.724039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.724572 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.881381 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:55.889303 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-02e71918-6582-4bac-906c-dc128f53652b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.179667 Aug 24 03:37:55.889875 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 85/172] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:55.891351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.891996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.898749 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.899235 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.899670 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.900388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.900855 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.901279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.049059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.057414 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6d396699-1f2e-45e5-bc36-d20a3bd6731a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.170036 Aug 24 03:37:56.058005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 88/173] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:56.341188 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.341790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:56.348463 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.348940 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.349395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.350084 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.350567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.350980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.470232 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.470842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:56.477700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.478215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.478709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.479364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.479817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.480241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.494214 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.503481 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.505012 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.506138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a6c95b45-9a82-4aeb-863b-87c663d42fcd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.168935 Aug 24 03:37:56.506737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 86/174] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:56 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:56.639266 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.649156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-386d214c-fbe2-4bc8-8cc6-bafa6ea23de7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.182668 Aug 24 03:37:56.649831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 89/175] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:56 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:56.913013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:56.913623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:56.919799 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.920278 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.920713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.921405 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:56.921848 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:56.922551 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.060726 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.069303 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9d21ecd0-62ae-4bf9-b836-2ebcb78e87a2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.160793 Aug 24 03:37:57.069883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 87/176] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:56 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:57.082251 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:57.083038 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:57.089001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.089478 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.089908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.090618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.091064 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.091485 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.224718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.232953 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-04710e43-f654-4cbf-847e-47cb98d2bbf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.154554 Aug 24 03:37:57.233643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 90/177] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:57 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:57.529039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:57.529557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:57.537288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.537766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.538205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.538908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.539353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.539768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.674301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.674623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:57.675342 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:57.681789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.682599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.683021 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.685196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.686698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.687933 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9b094e2f-f5e1-4521-8b53-f5fc5ecccadc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.162841 Aug 24 03:37:57.688114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.688679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.689106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.692942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 88/178] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:57 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:57.838620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.846852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3f769d25-0ff7-4523-8754-bc2bf753e40d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.176125 Aug 24 03:37:57.847426 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 91/179] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:57 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:58.089797 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:58.090512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.099056 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.100004 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.100619 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.101326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.101773 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.102218 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.258391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:58.259638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.266463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.266968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.267400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.268102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.269206 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.269632 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.271077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.282866 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-595a3afb-ef4a-460f-9197-c3424260c90b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.196783 Aug 24 03:37:58.284008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 89/180] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:58 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:58.425390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.433289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2dac084a-413e-4b3f-812b-8185128b4d80 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.181129 Aug 24 03:37:58.433862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 92/181] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:58 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:58.711235 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:58.711882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.718293 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.718817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.719256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.719953 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.720415 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.720842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.862927 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.866918 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:58.867659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.871287 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.872791 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.873705 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.873886 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b8da1ce9-c397-497a-9517-196bee5a3aa8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.166923 Aug 24 03:37:58.874357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.875210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 90/182] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:58 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:58.875356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.875732 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.876254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.876745 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.013200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:59.021914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9a44be11-3e8e-4c26-b7ee-00fd43b3342f tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.158834 Aug 24 03:37:59.022552 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 93/183] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:58 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:59.304547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:59.305058 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:59.311239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:59.311723 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:59.312149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.312842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:59.313285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:59.313699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.457132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:59.460540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:59.461178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:59.464894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-675709dc-5e86-445b-967a-6f3dc75b129c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.164740 Aug 24 03:37:59.465499 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 91/184] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:59 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:59.467216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:59.467706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:59.468143 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.468842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:59.469298 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:59.469720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.606111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:59.614315 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4250f5c8-1eb8-47ca-91e6-8e2cc4dc2edf tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.157966 Aug 24 03:37:59.614888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 94/185] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:59 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:59.896893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:59.897491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:59.904554 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:59.905140 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:59.905638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.906455 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:59.907010 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:59.907524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.043271 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:00.043891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:00.051061 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.051576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.052011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.052702 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.053149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.053563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.054719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.064400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.066574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.067675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7d107bc4-8125-4428-a470-19171092c870 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.174731 Aug 24 03:38:00.068240 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 92/186] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:59 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:00.191725 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.200798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e59e5ca8-30f8-4465-a0bc-8cb6fa2c7651 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.161427 Aug 24 03:38:00.201371 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 95/187] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:00 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:00.486157 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:00.486792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:00.494705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.495190 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.495627 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.496326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.496785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.497208 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.634104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.636127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:00.636757 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:00.641656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e24af5d2-9b65-4451-91f1-9f04ee053455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.159403 Aug 24 03:38:00.642241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 93/188] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:00 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:00.642732 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.643267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.643764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.644459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.644934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.645358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.781837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.790058 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8e679ec9-1a91-474b-9c4a-c4ba38603a6e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.157757 Aug 24 03:38:00.790652 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 96/189] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:00 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:01.090156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.090977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.099137 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.099623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.100054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.100751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.101469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.101723 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.222283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.222901 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.231154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.231668 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.232269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.233302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.234987 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.235430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.271605 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.279269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:01.290902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.294108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.296417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ff39ffb7-7084-41a4-b210-08f6588e6840 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.210449 Aug 24 03:38:01.298274 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 94/190] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:01 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:01.427001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.435463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b877cf36-ff34-4b58-8929-bee3c3849036 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.217336 Aug 24 03:38:01.436401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 97/191] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:01 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:01.660912 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.661518 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.669927 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.670519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.671238 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.672308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.673069 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.673514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.812949 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.813922 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.821186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.821831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.822452 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.823273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.823841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.824070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.824601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.835664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-311894a1-3e2e-48a3-8e82-eb83f0b7aa5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.178372 Aug 24 03:38:01.850596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 95/192] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:01 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:02.017380 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:02.026821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f2e0064a-eb89-483d-ad4a-131e75cf2fb0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.217862 Aug 24 03:38:02.027500 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 98/193] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:01 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:02.326612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:02.327377 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:02.335759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.336265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.337062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.337773 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.338247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.338669 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.465253 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:02.466351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:02.473014 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.473559 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.474630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.475335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.475892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.476242 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.537378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:02.549950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:02.552203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:02.553705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-113f946f-37a4-4847-852a-ce2df442f9ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.231581 Aug 24 03:38:02.555590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 96/194] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:02 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:02.659532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:02.668241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-46f3945d-5b86-4a2b-998d-7a9f107549cf tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.214803 Aug 24 03:38:02.669110 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 99/195] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:02 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:02.859438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:02.859995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:02.867841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.868340 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.868792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.869491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.869942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.870419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.059117 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:03.061162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.066400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:03.077575 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-09b42405-c03b-4d44-9656-669f22ea25dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.221948 Aug 24 03:38:03.093522 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.094027 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.094498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.095219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.095679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.096106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.097226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 97/196] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:02 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:03.214888 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-2ddd3681-79c3-455c-9c2f-e5afc430b64c req-df39c05e-9605-4308-b88e-5560b9bde0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b8aee4-3b6d-456c-8b11-b1616f1447ce", "name": "network-vif-plugged", "status": "completed", "tag": "708a6aa3-e1e7-4841-a71a-401bf123e882"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:03.230225 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2ddd3681-79c3-455c-9c2f-e5afc430b64c req-df39c05e-9605-4308-b88e-5560b9bde0ab service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.230985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2ddd3681-79c3-455c-9c2f-e5afc430b64c req-df39c05e-9605-4308-b88e-5560b9bde0ab service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.231647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2ddd3681-79c3-455c-9c2f-e5afc430b64c req-df39c05e-9605-4308-b88e-5560b9bde0ab service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.248181 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-2ddd3681-79c3-455c-9c2f-e5afc430b64c req-df39c05e-9605-4308-b88e-5560b9bde0ab service nova] Creating event network-vif-plugged:708a6aa3-e1e7-4841-a71a-401bf123e882 for instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce on hv-cinder-85426 Aug 24 03:38:03.256748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-2ddd3681-79c3-455c-9c2f-e5afc430b64c req-df39c05e-9605-4308-b88e-5560b9bde0ab service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049699 Aug 24 03:38:03.258746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 98/197] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:03.300049 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.308296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-846c5470-758b-433e-866a-3b249c70b562 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.252853 Aug 24 03:38:03.309047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 100/198] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:03 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:03.588115 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:03.589337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:03.597963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.598490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.598919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.599610 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.600058 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.600474 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.704845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:03.707721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:03.724155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.725165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.725845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.730917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.731481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.732020 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.806736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.815516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.817016 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.818140 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-96b4c42b-e0c6-4267-b035-e7d0c10c1b17 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.238595 Aug 24 03:38:03.830435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 99/199] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:03 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:03.958289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.972653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:03.989674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7a2a8777-a825-40ab-b552-7e3399e65ef1 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1315 microversion: 2.1 time: 0.291059 Aug 24 03:38:04.005840 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 101/200] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:03 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:04.099544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:04.100915 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:04.122294 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.123049 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.123700 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.124581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.125039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.125490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.330007 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:04.335337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:04.336592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:04.345993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.347678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.348366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.349476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.350209 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.351222 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ad5ce986-b793-4779-bc8d-41648d6ae48b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.256180 Aug 24 03:38:04.351350 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.360261 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 100/201] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:04 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:04.763974 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:04.773082 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0ab34395-058b-4272-955f-162aea96496d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.445285 Aug 24 03:38:04.774657 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 102/202] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:04 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:04.843950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:04.844616 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:04.853791 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.854324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.854748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.855607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.856051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.856469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.994826 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.008162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.008162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.008162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6a2373be-fcdd-4530-9ff3-5650a3976965 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1408 microversion: 2.20 time: 0.167283 Aug 24 03:38:05.008635 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 101/203] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:04 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:38:05.018950 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:05.020132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:05.026246 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.026791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.027283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.028042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.028750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.029107 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.197802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.202751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-181ca363-352b-4e68-ad59-30f08318fe72 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1501 microversion: 2.1 time: 0.189821 Aug 24 03:38:05.203440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 103/204] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:05 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:05.373671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:05.374306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:05.385001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.385956 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.386610 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.387312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.388525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.389692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.562903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.574555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8cde6742-4d48-487b-ae86-f5b8f9aa9608 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.204805 Aug 24 03:38:05.575388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 102/205] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:05 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:05.798488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:05.799188 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:05.805376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.805922 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.806451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.807227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.807897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.808328 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.951134 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:05.960506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ae85841e-8514-4be6-9c65-b49043e789c2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.166394 Aug 24 03:38:05.961082 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 104/206] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:05 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:06.032537 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:06.034772 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:06.040883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.041528 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.042127 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.042837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.043285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.043700 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.193556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.201930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.203449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.204616 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f1aa667a-c9da-4c35-bf89-6f6222d41148 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1600 microversion: 2.20 time: 0.177032 Aug 24 03:38:06.205156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 103/207] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:38:06 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:38:06.228568 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:06.229050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:06.235032 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.235506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.235957 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.236630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.237088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.237499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.353773 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-673fc2a3-395b-4f8a-b5cf-975f87f1d02c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128972 Aug 24 03:38:06.354392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 105/208] 10.222.0.91 () {60 vars in 1316 bytes} [Wed Aug 24 03:38:06 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:38:06.599676 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:06.600337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:06.606403 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.606890 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.607325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.608100 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.608551 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.608971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.766817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.786299 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bc72f8fd-dc6c-4a58-aa49-0ef1b0ff4b82 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.191281 Aug 24 03:38:06.787010 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 104/209] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:06 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:06.981074 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:06.981655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:06.987863 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.988344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.988761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.989647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:06.990099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:06.990941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.238521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:07.247326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e79a644f-8923-4520-b422-60067c63901e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.270119 Aug 24 03:38:07.248002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 106/210] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:06 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:07.642458 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-466aa533-52cf-45be-a1e9-d18e5897959a req-91c2b9d9-e915-49af-b67d-c0e65923660a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e834164b-a670-4f2a-8322-0d968d8e6703", "tag": "0f8767fa-c35d-4362-bf07-a72ca2d4c311"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:07.651762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-466aa533-52cf-45be-a1e9-d18e5897959a req-91c2b9d9-e915-49af-b67d-c0e65923660a service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.652245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-466aa533-52cf-45be-a1e9-d18e5897959a req-91c2b9d9-e915-49af-b67d-c0e65923660a service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.652675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-466aa533-52cf-45be-a1e9-d18e5897959a req-91c2b9d9-e915-49af-b67d-c0e65923660a service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.664120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-466aa533-52cf-45be-a1e9-d18e5897959a req-91c2b9d9-e915-49af-b67d-c0e65923660a service nova] Creating event network-changed:0f8767fa-c35d-4362-bf07-a72ca2d4c311 for instance e834164b-a670-4f2a-8322-0d968d8e6703 on hv-cinder-85426 Aug 24 03:38:07.670537 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-466aa533-52cf-45be-a1e9-d18e5897959a req-91c2b9d9-e915-49af-b67d-c0e65923660a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031584 Aug 24 03:38:07.671246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 105/211] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:07.809186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:07.810075 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:07.817941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.818481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.818928 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.819911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.820395 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.820839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.979610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:07.989741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bcc6795b-c144-4219-b500-0bfff02cda66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.184298 Aug 24 03:38:07.994238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 107/212] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:07 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:08.269789 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.270549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:08.277788 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.278618 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.279329 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.280485 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.281056 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.281783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.452005 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:08.462884 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0bc28854-346b-42c9-a2a4-69dc60e4fc5c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.198107 Aug 24 03:38:08.463735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 106/213] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:09.011542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:09.012160 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:09.019088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.019576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.020008 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.020700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.021155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.021575 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.175124 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:09.188040 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a458dece-44d4-4d6a-9953-dbd0117f03da tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.179890 Aug 24 03:38:09.189093 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 108/214] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:09 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:09.483987 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:09.484705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:09.491456 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.491946 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.492414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.493136 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.493587 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.494008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.636763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:09.644929 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8f3562ee-fbf1-4491-a550-70275d3ec91b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.164776 Aug 24 03:38:09.645504 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 107/215] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:09 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:10.213599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:10.214214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:10.221001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.221712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.222004 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.222806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.223250 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.223663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.614739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:10.629011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-355c1f8f-a773-4944-b554-3b9ae06a045c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.419637 Aug 24 03:38:10.642729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 109/216] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:10 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:10.664889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:10.665709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:10.671999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.672950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.673604 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.674984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.675430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.675880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.822061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:10.829754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2803d414-e234-4056-a7ed-8b3aee5d82f8 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.168723 Aug 24 03:38:10.830342 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 108/217] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:10 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:11.653166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:11.654272 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:11.662154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.663333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:11.664175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.664736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.665214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:11.826934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:11.837370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a04706fe-e745-44f0-8348-78e59ceb9f66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.188585 Aug 24 03:38:11.838221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 110/218] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:11 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:11.852516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:11.853622 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:11.859794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.860271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.860697 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:11.861378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.862408 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.862862 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.010623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:12.020389 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-282bfdce-1184-46ea-b256-d00909125a5a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.172399 Aug 24 03:38:12.020977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 109/219] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:11 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:12.130649 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d101e31-a772-4495-a821-896eb50ad9b6"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:12.135964 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:12.139607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.140092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.140701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.141361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.141807 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.142241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.859568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:12.860186 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:12.867047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.867502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.867967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.868688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.869243 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.869745 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:13.002340 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:13.010893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-716345e9-a019-4eaf-860b-4b8355678502 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.155320 Aug 24 03:38:13.011460 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 110/220] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:12 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:13.047751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:13.048384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:13.054749 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:13.055343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:13.055794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:13.056508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:13.056962 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:13.057390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:13.210954 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:13.219713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-94c4b33f-4111-4d42-82d4-2a57151ffaf7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1365 microversion: 2.1 time: 0.176082 Aug 24 03:38:13.220286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 111/221] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:13 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:14.032981 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:14.033938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:14.040030 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:14.040514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:14.040969 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.041651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:14.042105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:14.042584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.193181 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:14.196507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:14.204152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-991ad227-baa1-4804-bec8-401d57fc726f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.174767 Aug 24 03:38:14.204879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 112/222] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:14 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:14.240517 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:14.241469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:14.249403 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:14.249883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:14.250526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.251493 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:14.252145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:14.253317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.436584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:14.445738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-85aac843-98cf-4f32-86ed-e69cbfa7fbef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1555 microversion: 2.1 time: 0.210004 Aug 24 03:38:14.446559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 113/223] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:14 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:14.468530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:14.469014 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:14.476566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:14.477068 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:14.477483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.478174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:14.478735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:14.479155 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:14.639298 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-906ccef4-9f4d-4c79-a7dd-80d48cfd3818 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174528 Aug 24 03:38:14.639949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 114/224] 10.222.0.91 () {58 vars in 1275 bytes} [Wed Aug 24 03:38:14 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:15.226485 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:15.227163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:15.233289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:15.233795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:15.234257 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:15.234943 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:15.235397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:15.235851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:15.593668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:15.602508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-904490aa-53d8-414f-880f-8a0695dc24c9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.380049 Aug 24 03:38:15.603074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 115/225] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:15 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:16.145836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-babb78df-8685-4cd1-b61c-c7d7ad2b8a02 req-b830f030-b66e-4197-a142-deb2e2dfbff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88860171-756d-4701-a8e0-095fd12fa4e6", "tag": "c4edcf8c-59e5-415c-bc26-f08f91e47a56"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:16.155357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-babb78df-8685-4cd1-b61c-c7d7ad2b8a02 req-b830f030-b66e-4197-a142-deb2e2dfbff3 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.155828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-babb78df-8685-4cd1-b61c-c7d7ad2b8a02 req-b830f030-b66e-4197-a142-deb2e2dfbff3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.156260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-babb78df-8685-4cd1-b61c-c7d7ad2b8a02 req-b830f030-b66e-4197-a142-deb2e2dfbff3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:16.168658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-babb78df-8685-4cd1-b61c-c7d7ad2b8a02 req-b830f030-b66e-4197-a142-deb2e2dfbff3 service nova] Creating event network-changed:c4edcf8c-59e5-415c-bc26-f08f91e47a56 for instance 88860171-756d-4701-a8e0-095fd12fa4e6 on hv-cinder-85426 Aug 24 03:38:16.175564 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-babb78df-8685-4cd1-b61c-c7d7ad2b8a02 req-b830f030-b66e-4197-a142-deb2e2dfbff3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032464 Aug 24 03:38:16.176457 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 116/226] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:16.390933 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f2c701ff-acd1-4f3e-a639-fb149770a9c9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "POST /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.264679 Aug 24 03:38:16.398116 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 111/227] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:38:12 2022] POST /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0/os-volume_attachments => generated 194 bytes in 4273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:16.625692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:16.626451 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:16.633376 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.633930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.634422 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:16.635116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:16.635576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:16.635987 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:16.849292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:16.859246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0ee78efd-65e2-4b54-855c-b26ac109a531 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1321 microversion: 2.1 time: 0.237739 Aug 24 03:38:16.859827 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 117/228] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:16 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:17.884099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:17.884889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:17.887523 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=86 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:17.894229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:17.894884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:17.895332 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:17.896244 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:17.896709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:17.897136 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:18.046599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:18.055229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-024aff40-6819-4c0c-9e43-c8c2f2298632 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1516 microversion: 2.1 time: 0.177831 Aug 24 03:38:18.055816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 112/229] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:17 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:18.076052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:18.078310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:18.086655 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=92 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:18.101226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:18.101632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:18.104439 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:18.105473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:18.106527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:18.106965 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:18.134095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.objects.instance [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lazy-loading 'flavor' on Instance uuid 10b8aee4-3b6d-456c-8b11-b1616f1447ce {{(pid=127260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:18.353093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b990ba23-21b1-4fec-90a5-1b77f7fc59b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce/action" status: 200 len: 32 microversion: 2.1 time: 0.280676 Aug 24 03:38:18.353992 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 118/230] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:38:18 2022] POST /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:38:18.364001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:18.365042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:18.375477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:18.376361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:18.377116 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:18.378787 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:18.379476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:18.380120 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:18.682769 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:18.695055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2b4e21f2-ec2e-4618-a810-08d22e146af5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.334583 Aug 24 03:38:18.696182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 113/231] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:18 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:19.719973 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:19.720737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:19.737101 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.737969 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.738603 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.739790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.740733 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.741461 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.927826 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:19.936039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6d7f80dc-4a5b-4570-9942-ffa81e39d51b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.221433 Aug 24 03:38:19.950528 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 119/232] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:19 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:20.961194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:20.961937 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:20.968989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:20.969479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:20.969919 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:20.970821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:20.972176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:20.972896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.147138 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:21.156420 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-87c09e47-09ca-42cb-88da-985a901c5bff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.201571 Aug 24 03:38:21.157328 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 114/233] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:20 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:22.178523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:22.179193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:22.185854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.186364 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.186801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.187491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.187942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.188359 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.328932 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:22.337545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f90df75d-fd8b-434f-b9af-8162360f4663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.162830 Aug 24 03:38:22.338117 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 120/234] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:22 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:23.359908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:23.360511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:23.366703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:23.367221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:23.367721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:23.368414 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:23.368938 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:23.369389 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:23.581359 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:23.589896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7802b26c-d363-452a-8bc7-cb866f264f8d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.233712 Aug 24 03:38:23.600145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 115/235] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:23 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:24.612785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:24.613386 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:24.620584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.620584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.621029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.621439 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.621889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.622343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.764064 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:24.772202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f023a512-ece7-4dbe-8b12-ad6a92e3763e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.163524 Aug 24 03:38:24.772777 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 121/236] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:24 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:25.793625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:25.794249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:25.801664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.802148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.802604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.803316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.803766 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.804190 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.935860 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:25.946376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b148d3f0-3e8a-4e8e-aa26-0a2787982d9c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.156494 Aug 24 03:38:25.946961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 116/237] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:25 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:26.594928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-932288400", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "networks": [{"uuid": "abba8734-dfda-4c08-ba98-1f901a1ff528"}]}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:26.652132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] validate_networks() for [('abba8734-dfda-4c08-ba98-1f901a1ff528', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:26.968358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:26.968978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:26.975831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:26.976335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:26.976789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:26.977807 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:26.978316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:26.978752 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.011617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:27.024880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:38:27.025293 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:38:27.025764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:38:27.026162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:38:27.026614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:38:27.038111 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.054095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.054601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.055430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.055896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.056322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.076468 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Getting quotas for project 97e2f9bd5a7b4fc8828847d518968bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:27.083375 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Getting quotas for user 5439318804a745d98ee897fb511ed9af and project 97e2f9bd5a7b4fc8828847d518968bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:27.096183 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:38:27.098792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:38:27.144485 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:27.150137 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-35b99e3e-8dcd-4b35-9b18-6b7f44d1e4df tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558625 Aug 24 03:38:27.150750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 122/238] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:38:27.166427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a9125cf7-e516-4997-9325-ebce3c6ce41d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.201928 Aug 24 03:38:27.173543 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-70309f33-346a-498c-944c-ef02cb479365 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:27.175159 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-70309f33-346a-498c-944c-ef02cb479365 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:27.183842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 117/239] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:26 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:27.264230 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-70309f33-346a-498c-944c-ef02cb479365 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:27.272977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-70309f33-346a-498c-944c-ef02cb479365 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1213 microversion: 2.1 time: 0.104875 Aug 24 03:38:27.274300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 123/240] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:27 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:28.195879 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:28.196496 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:28.203547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:28.204030 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:28.204465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:28.206210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:28.206674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:28.207194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:28.302419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:28.302419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:28.302419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:28.302419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:28.303290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:28.303290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:28.303449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:28.303984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:28.354898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:28.369683 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ea844d79-ab5d-42a7-87a5-a9fb52105ee6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.177977 Aug 24 03:38:28.370475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:28.383564 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 118/241] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:28 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:28.385469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1de3d4fc-7f44-4637-a741-462fb6703d83 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1209 microversion: 2.1 time: 0.095374 Aug 24 03:38:28.386246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 124/242] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:28 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:29.391935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.393095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.399768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.400253 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.400691 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.401387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.402014 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.402542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.409511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.410053 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.416674 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.417272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.417810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.418613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.419132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.419714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.561063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:29.570610 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e713e0bb-4b54-41f3-b2f9-33fcda41035b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1273 microversion: 2.1 time: 0.166711 Aug 24 03:38:29.571424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 125/243] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:29 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:29.576844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.577777 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.598091 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.599094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.599894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.601262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.603064 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.604252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.665136 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:29.729430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:29.742668 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e3c81355-cc80-4dda-a373-58e50a637894 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.355014 Aug 24 03:38:29.744364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 119/244] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:29 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:29.796576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-284ad607-a453-46e5-9329-587cd70cf8f0 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "DELETE /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 204 len: 0 microversion: 2.1 time: 0.223643 Aug 24 03:38:29.797246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 126/245] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:29 2022] DELETE /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:38:29.805757 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.806474 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.812728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.813376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.813806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.815286 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.815890 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.816456 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.964093 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:29.973147 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4ef2f5b0-8a13-465d-b80d-05499adf04a9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1553 microversion: 2.1 time: 0.171121 Aug 24 03:38:29.974117 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 120/246] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:29 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:30.594094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:30.594839 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:30.601126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.601604 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.602034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.602834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.603289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.603709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.743320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:30.752969 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cfb1b9db-1bea-4fa9-a23a-d992ca4548d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.162405 Aug 24 03:38:30.753292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 127/247] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:30 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:30.775657 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:30.775657 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:30.780858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.780858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.780858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.781549 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.782006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.782456 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.916149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:30.924178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-86c469d8-d180-4dc0-81bd-d3a84d90222c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.155041 Aug 24 03:38:30.924747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 121/248] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:30 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:30.997041 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:30.997041 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:31.002239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.002732 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.003209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.003820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.004272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.004681 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.020201 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:31.150883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:31.159886 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3b878b4c-1d97-4529-a75b-412dbab73166 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1553 microversion: 2.1 time: 0.167996 Aug 24 03:38:31.160607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 128/249] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:30 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:31.775248 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:31.775996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:31.782650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.783260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.784293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.785062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.785585 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.786080 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.926402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:31.934152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1b2d1890-0f7b-440f-be0d-082fbabfc08c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.163289 Aug 24 03:38:31.934756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 122/250] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:31 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:31.952071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:31.952688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:31.959402 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.959887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.960320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.961019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.961473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.961894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.092841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:32.101176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9f5308ba-3f70-402f-80dc-405207b88b09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.152992 Aug 24 03:38:32.101764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 129/251] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:31 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:32.183325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:32.183966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:32.190678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.191158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.191596 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.192289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.192737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.193161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.345859 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:32.354484 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1a280be5-9efb-49ba-b78f-2fb66ee785e9 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1553 microversion: 2.1 time: 0.176355 Aug 24 03:38:32.355171 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 123/252] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:32 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:32.956075 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:32.957751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:32.968046 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.968560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.969169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.970149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.971182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.976357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.125851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:33.127256 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:33.143207 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.144521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.145358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.146861 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.147878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.148870 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.220834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:33.235172 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-249911a7-1bd1-4d5e-ad24-b74dcb2c44a5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.282827 Aug 24 03:38:33.250960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 130/253] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:32 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:33.305475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-63f5f4fa-d72c-4cd0-b23d-d000ff2b0164 req-9cbc8847-e5c8-4f60-bca7-546a2e6f217c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1464a48-511e-4582-80be-aa1330f298ac", "tag": "736b7877-c873-421f-a96b-0ec89bd67b32"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:33.327387 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-63f5f4fa-d72c-4cd0-b23d-d000ff2b0164 req-9cbc8847-e5c8-4f60-bca7-546a2e6f217c service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.329031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-63f5f4fa-d72c-4cd0-b23d-d000ff2b0164 req-9cbc8847-e5c8-4f60-bca7-546a2e6f217c service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.329465 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-63f5f4fa-d72c-4cd0-b23d-d000ff2b0164 req-9cbc8847-e5c8-4f60-bca7-546a2e6f217c service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.330651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:33.349255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-63f5f4fa-d72c-4cd0-b23d-d000ff2b0164 req-9cbc8847-e5c8-4f60-bca7-546a2e6f217c service nova] Creating event network-changed:736b7877-c873-421f-a96b-0ec89bd67b32 for instance d1464a48-511e-4582-80be-aa1330f298ac on hv-cinder-85426 Aug 24 03:38:33.355010 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-63f5f4fa-d72c-4cd0-b23d-d000ff2b0164 req-9cbc8847-e5c8-4f60-bca7-546a2e6f217c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057059 Aug 24 03:38:33.358920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 131/254] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:33.361931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6e7e1fa6-be28-44be-8715-bada3bc92a0c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.242619 Aug 24 03:38:33.362550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 124/255] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:33 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:33.382342 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:33.383052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:33.390428 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.391046 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.391345 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.392038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.393174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.393453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.531286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:33.541006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-49332ac5-8d52-429b-b3b2-cee680ccee87 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1553 microversion: 2.1 time: 0.167815 Aug 24 03:38:33.541654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 132/256] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:33 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:34.257850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:34.258518 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:34.265798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.266742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.267197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.268176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.268628 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.269050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.386137 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:34.388263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:34.396253 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.397196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.397903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.399014 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.399668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.400395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.415600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:34.425214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-068ca120-8a23-4673-ad4b-35f3f5bc223f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.171393 Aug 24 03:38:34.426037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 125/257] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:34 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:34.562612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:34.563235 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:34.570622 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.571139 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.571548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.572252 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:34.572703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:34.573127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.758344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:34.767303 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-540dcda9-5e99-4705-8a0b-12645c1eb2b7 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1553 microversion: 2.1 time: 0.208478 Aug 24 03:38:34.781338 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 126/258] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:34 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:34.950576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:34.960938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ae2b30f4-e51b-49cc-a6d1-fb1bf984ef2c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.580564 Aug 24 03:38:34.972216 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 133/259] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:34 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:35.446604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:35.447218 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:35.464315 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.466067 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.467234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.474845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.477335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.477820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.559772 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-35381175-e4bb-4ade-96b0-2ec8b9bf4668 req-bdac927a-b03f-4962-8100-e25577a771e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f3d229-1d44-43cd-83d5-7640dbcd03d0", "name": "network-vif-deleted", "tag": "aa5bc36b-e721-496e-8812-48b7a0b6d9b9"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:35.576085 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-35381175-e4bb-4ade-96b0-2ec8b9bf4668 req-bdac927a-b03f-4962-8100-e25577a771e4 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.576845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-35381175-e4bb-4ade-96b0-2ec8b9bf4668 req-bdac927a-b03f-4962-8100-e25577a771e4 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.581550 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-35381175-e4bb-4ade-96b0-2ec8b9bf4668 req-bdac927a-b03f-4962-8100-e25577a771e4 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.602851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-35381175-e4bb-4ade-96b0-2ec8b9bf4668 req-bdac927a-b03f-4962-8100-e25577a771e4 service nova] Creating event network-vif-deleted:aa5bc36b-e721-496e-8812-48b7a0b6d9b9 for instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 on hv-cinder-85426 Aug 24 03:38:35.612194 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-35381175-e4bb-4ade-96b0-2ec8b9bf4668 req-bdac927a-b03f-4962-8100-e25577a771e4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055923 Aug 24 03:38:35.613070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 134/260] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:35.711487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:35.721765 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b31753d6-ded6-4278-a1b9-5a4e6546a27e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.279049 Aug 24 03:38:35.722455 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 127/261] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:35 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:35.791347 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:35.792331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:35.799818 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.800306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.800955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.801571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.801903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.802564 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.910305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:35.919688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d8e42192-577c-4744-8100-51d87813f515 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1346 microversion: 2.1 time: 0.134092 Aug 24 03:38:35.920394 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 135/262] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:35 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:35.984013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:35.985215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:35.992931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.993343 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.993784 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.994506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.995423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.996133 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.185570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:36.193932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6a2e473d-420c-43af-bb55-6b632ab6dbc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.214688 Aug 24 03:38:36.194543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 128/263] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:35 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:36.748430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:36.750795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:36.765099 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:36.770065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:36.770558 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.771295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:36.771758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:36.772186 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.941053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:36.941736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:36.949394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:36.950356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:36.951026 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.952039 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:36.953568 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:36.954262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.982460 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:36.997798 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4d5ca768-5143-46da-9a25-56536747ba09 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.257745 Aug 24 03:38:36.999124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 136/264] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:36 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:37.035810 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:37.045758 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f58afe83-d734-44d1-9e4f-1316320551aa tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1346 microversion: 2.1 time: 0.108491 Aug 24 03:38:37.058211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 129/265] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:36 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:37.214645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:37.215251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:37.220584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:37.224706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.225435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.226072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.227163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.227630 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.228059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.274871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=8 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:37.559688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:37.577584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-743c4b7d-e36f-4861-bd85-d32d2b400648 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.366637 Aug 24 03:38:37.579310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 137/266] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:37 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:38.024274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:38.025022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:38.032045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.032665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.033255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.034063 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.034655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.035173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.075944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:38.078588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:38.090079 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.090633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.091245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.092089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.092758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.093193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.192886 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:38.194518 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:38.200649 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-27689136-a324-4f12-ac4a-0745a7e5c882 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.184728 Aug 24 03:38:38.201885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 130/267] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:38 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:38.205018 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-acdbbc27-4834-48b3-914e-ebc723aa4394 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1346 microversion: 2.1 time: 0.135836 Aug 24 03:38:38.219507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 138/268] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:38 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:38.603041 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:38.604687 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:38.615078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.616208 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.617440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.619410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.620604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.621730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.914480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:38.948121 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6c46f267-4ad5-4ada-ab6c-bb1f9fb9b6f9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.348127 Aug 24 03:38:38.950772 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 131/269] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:38 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:39.240071 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:39.241402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:39.242961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:39.244178 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:39.251485 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.252268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.253148 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.253787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.254425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.254973 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.255731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.256400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.257029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.260512 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.262387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.262957 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.316071 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.316721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.317581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.318139 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lazy-loading 'fault' on Instance uuid 48f3d229-1d44-43cd-83d5-7640dbcd03d0 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:39.410527 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1047b63c4148ca8073e3414ef84d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aa6850ae4d44619cc27cef9dcadc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:39.421306 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-59628957-55a8-4463-86b3-5a2f7c8496f6 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 200 len: 1351 microversion: 2.1 time: 0.192713 Aug 24 03:38:39.423639 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 132/270] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:39 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 1351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:39.545757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:39.564988 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a87a0bf4-ffba-41d4-974b-980ac0e38bee tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.336211 Aug 24 03:38:39.584671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 139/271] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:39 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:39.972052 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:39.973041 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:39.980195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.981735 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.983019 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.984187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.984847 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.985461 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.168715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:40.173172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:40.179968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-efdc8932-3a63-4c8c-bd19-a81b31ab7fff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.214940 Aug 24 03:38:40.180716 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 133/272] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:39 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:40.446513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:40.447458 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:40.454561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.456527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.457127 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.458076 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.458716 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.459446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.483702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] HTTP exception thrown: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Request method failure captured: Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 HTTP/1.1 Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzQDgH0cvNNR1mhvTvfEtW2bGgXjlALcoK7yris_Mh66Vmcqw3r7sr4pkvKGhK3u2h2LGUx2cCouUGCMSq0p100igRd7Gi8p7tLrtEsOTIwJBE-mJ7x5B1_UNMYXxPek0LZBJtZqh1qADjUkpZIvu5umHgLDetIq4PCdrLQkTYan3Q Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 53aa6850ae4d44619cc27cef9dcadc61 Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:38:40.497285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 53aa6850ae4d44619cc27cef9dcadc61 Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-DeleteServersTestJSON-1111530308-project Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 7f1047b63c4148ca8073e3414ef84d28 Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-DeleteServersTestJSON-1111530308-project Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.498644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '48f3d229-1d44-43cd-83d5-7640dbcd03d0'} Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:40.499365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.500545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.501580 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Returning 404 to user: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:40.501580 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-fbee08b5-610b-47a7-9286-4ba6a335ee88 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 404 len: 111 microversion: 2.1 time: 0.057238 Aug 24 03:38:40.501580 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 140/273] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:40 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:40.609234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:40.610512 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:40.621404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.621980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.622454 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.623160 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.623688 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.624025 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.634954 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:40.640496 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:40.651532 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.651995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.652435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.653396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.654449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.655231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.678008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] HTTP exception thrown: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Request method failure captured: Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0/os-volume_attachments HTTP/1.1 Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzQDgH0cvNNR1mhvTvfEtW2bGgXjlALcoK7yris_Mh66Vmcqw3r7sr4pkvKGhK3u2h2LGUx2cCouUGCMSq0p100igRd7Gi8p7tLrtEsOTIwJBE-mJ7x5B1_UNMYXxPek0LZBJtZqh1qADjUkpZIvu5umHgLDetIq4PCdrLQkTYan3Q Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 53aa6850ae4d44619cc27cef9dcadc61 Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:38:40.680670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 53aa6850ae4d44619cc27cef9dcadc61 Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-DeleteServersTestJSON-1111530308-project Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 7f1047b63c4148ca8073e3414ef84d28 Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-DeleteServersTestJSON-1111530308-project Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'server_id': '48f3d229-1d44-43cd-83d5-7640dbcd03d0'} Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:40.682719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:40.683971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:40.686783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Returning 404 to user: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:40.688066 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1def3fda-e97d-4ea9-9198-dff2d40f1d98 tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066373 Aug 24 03:38:40.690292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 141/274] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:38:40 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:38:40.954162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:40.965114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-739cf806-66b4-4851-887a-4c4175ad9b0d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.359691 Aug 24 03:38:40.966240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 134/275] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:40 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:41.204800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:41.206271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:41.213350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.213853 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:41.214354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.215340 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.216112 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:41.216702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.455705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:41.470118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cef6ec2b-4067-4ef0-a11e-88fce10f0ae9 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.269742 Aug 24 03:38:41.484673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 142/276] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:41 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:41.989874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:41.990913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:41.991382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:41.991503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:41.998640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.999693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.000307 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.001213 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.001718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.002040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.002368 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.002812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.002929 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.003712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.004314 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.004817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.020930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] HTTP exception thrown: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Request method failure captured: Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: DELETE /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 HTTP/1.1 Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzQDgH0cvNNR1mhvTvfEtW2bGgXjlALcoK7yris_Mh66Vmcqw3r7sr4pkvKGhK3u2h2LGUx2cCouUGCMSq0p100igRd7Gi8p7tLrtEsOTIwJBE-mJ7x5B1_UNMYXxPek0LZBJtZqh1qADjUkpZIvu5umHgLDetIq4PCdrLQkTYan3Q Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 53aa6850ae4d44619cc27cef9dcadc61 Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:38:42.022931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 53aa6850ae4d44619cc27cef9dcadc61 Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-DeleteServersTestJSON-1111530308-project Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 7f1047b63c4148ca8073e3414ef84d28 Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-DeleteServersTestJSON-1111530308-project Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.024482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '48f3d229-1d44-43cd-83d5-7640dbcd03d0'} Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:42.025314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.026581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.029578 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Returning 404 to user: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:42.030543 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-37bb6e89-e233-4e97-b2f8-96d00c3fff4d tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "DELETE /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 404 len: 111 microversion: 2.1 time: 0.045217 Aug 24 03:38:42.031104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 143/277] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:41 2022] DELETE /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:42.040837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:42.041761 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] [instance: 48f3d229-1d44-43cd-83d5-7640dbcd03d0] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:42.052152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.052985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.053802 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.055764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.056475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.057123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.080657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] HTTP exception thrown: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Request method failure captured: Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 HTTP/1.1 Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzQDgH0cvNNR1mhvTvfEtW2bGgXjlALcoK7yris_Mh66Vmcqw3r7sr4pkvKGhK3u2h2LGUx2cCouUGCMSq0p100igRd7Gi8p7tLrtEsOTIwJBE-mJ7x5B1_UNMYXxPek0LZBJtZqh1qADjUkpZIvu5umHgLDetIq4PCdrLQkTYan3Q Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 53aa6850ae4d44619cc27cef9dcadc61 Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:38:42.083332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/53aa6850ae4d44619cc27cef9dcadc61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 53aa6850ae4d44619cc27cef9dcadc61 Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-DeleteServersTestJSON-1111530308 Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-DeleteServersTestJSON-1111530308-project Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 7f1047b63c4148ca8073e3414ef84d28 Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-DeleteServersTestJSON-1111530308-project Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.084621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '48f3d229-1d44-43cd-83d5-7640dbcd03d0'} Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:42.085306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. Aug 24 03:38:42.086450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:42.089746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] Returning 404 to user: Instance 48f3d229-1d44-43cd-83d5-7640dbcd03d0 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:42.091486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-80e0e5f0-4a8b-4c4d-a735-baf94010022e tempest-DeleteServersTestJSON-1111530308 tempest-DeleteServersTestJSON-1111530308-project] 10.222.0.91 "GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0" status: 404 len: 111 microversion: 2.1 time: 0.055460 Aug 24 03:38:42.095967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 144/278] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:42 2022] GET /compute/v2.1/servers/48f3d229-1d44-43cd-83d5-7640dbcd03d0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:42.157313 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:42.166059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-94e607e0-9227-4dcd-b049-a71841a43f65 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.180691 Aug 24 03:38:42.175317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 135/279] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:41 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:42.498270 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:42.498806 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:42.506263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.506927 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.507432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.508219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.508745 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.509239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.895598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:42.911934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-11d1b64c-550a-4985-9519-4dbfc863fe1c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.417694 Aug 24 03:38:42.912421 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 145/280] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:42 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:43.187934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:43.188552 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:43.199267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.199755 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.200194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.200890 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.201345 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.201770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.452588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:43.462594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-76a554fc-d2cb-43e4-9923-24bee0ac523c tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.278204 Aug 24 03:38:43.464250 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 136/281] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:43 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:43.933367 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:43.934317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:43.943330 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.943848 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.944295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.945033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.945657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.946829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:44.323397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:44.338914 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-499e1021-3190-4d26-a15e-3a0c304365bc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.405872 Aug 24 03:38:44.339670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 146/282] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:43 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:44.483685 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:44.485020 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:44.492917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:44.493882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:44.494584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:44.495885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:44.496430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:44.496938 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:44.704901 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:44.715592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0591fb71-a2d9-488a-af52-61796ae2f8c7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.235660 Aug 24 03:38:44.716895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 137/283] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:44 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:45.362642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:45.363457 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:45.372697 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.373184 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.386787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.388689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.389177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.389619 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.745872 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:45.750828 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:45.766404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.768574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.770950 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.772234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.774162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.776164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.889724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:45.905798 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2ab2b1d7-c824-442b-b566-755dadb58cec tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.549615 Aug 24 03:38:45.915270 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 147/284] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:45 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:45.927279 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-1d68b409-8f69-485f-ae8f-855ad4367144 req-c4f091e4-aa3e-4ce7-8538-53b7af0fdb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1464a48-511e-4582-80be-aa1330f298ac", "name": "network-vif-plugged", "status": "completed", "tag": "736b7877-c873-421f-a96b-0ec89bd67b32"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:45.937197 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1d68b409-8f69-485f-ae8f-855ad4367144 req-c4f091e4-aa3e-4ce7-8538-53b7af0fdb52 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:45.937895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1d68b409-8f69-485f-ae8f-855ad4367144 req-c4f091e4-aa3e-4ce7-8538-53b7af0fdb52 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:45.945240 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1d68b409-8f69-485f-ae8f-855ad4367144 req-c4f091e4-aa3e-4ce7-8538-53b7af0fdb52 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:45.969621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-1d68b409-8f69-485f-ae8f-855ad4367144 req-c4f091e4-aa3e-4ce7-8538-53b7af0fdb52 service nova] Creating event network-vif-plugged:736b7877-c873-421f-a96b-0ec89bd67b32 for instance d1464a48-511e-4582-80be-aa1330f298ac on hv-cinder-85426 Aug 24 03:38:45.984903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-1d68b409-8f69-485f-ae8f-855ad4367144 req-c4f091e4-aa3e-4ce7-8538-53b7af0fdb52 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067796 Aug 24 03:38:45.985718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 148/285] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:46.129573 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:46.144084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-18657abf-9ae1-416b-8832-b9a398c204b4 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.408713 Aug 24 03:38:46.147119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 138/286] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:45 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:46.929300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:46.930017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:46.938846 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.940638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.941618 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.944181 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.944872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.945477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.167249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:47.167730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:47.180895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.181681 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.182303 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.183160 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.185847 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.186561 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.228070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:47.230625 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:47.244111 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9d9fdc11-8e91-4e9f-98fd-29d49c0ef3fc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.319222 Aug 24 03:38:47.258663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 149/287] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:46 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:47.522076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:47.535461 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-671f19e2-0052-4f53-8a37-8cafb6e1b72d tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.372002 Aug 24 03:38:47.536220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 139/288] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:47 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:48.268318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:48.268945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:48.271073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:48.277678 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.278175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.278718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.279439 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.279931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.280361 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.442528 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:48.451941 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e5623642-09fc-4c0a-afb8-011307042673 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.188707 Aug 24 03:38:48.452860 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 150/289] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:48 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:48.557481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:48.558088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:48.561593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=58 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:48.566839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.567401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.567906 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.568604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.569062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.569489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.896707 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:48.915224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3eeb433e-462b-4ced-868e-e7030f831e21 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1313 microversion: 2.1 time: 0.356891 Aug 24 03:38:48.944864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 140/290] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:48 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:49.476908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:49.477607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:49.494651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.498447 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.499141 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.501296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.503341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.503972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.740000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:49.754337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-09de6e4c-7f6e-4865-ba92-0900ea508840 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.284485 Aug 24 03:38:49.755925 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 141/291] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:49 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:49.801951 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8d837bff-7f10-42ef-afd8-67d52a873390 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Action: 'create', calling method: .version_select at 0x7f077c4ee280>, body: {"keypair": {"name": "tempest-TestShelveInstance-169979743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODge/bZQ3xYa6cSrqitDyZUkBs9r/I7ZwXWj9tVhXri6/RjKpbuqPsmuXxhJJxDPr1y9Gvtz4/H4g86gWwoRaVHfkTdCQ2OP09ndDcF98KzN7uDzS5dIDmag0PR+FWrAA=="}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:49.824743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-8d837bff-7f10-42ef-afd8-67d52a873390 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Getting quotas for project cc4ed4d70a074b97acf12130e4b00bcb. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:49.829573 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-8d837bff-7f10-42ef-afd8-67d52a873390 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Getting quotas for user c0c89aa8c55042e7af5452f1a94318a9 and project cc4ed4d70a074b97acf12130e4b00bcb. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:49.863307 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8d837bff-7f10-42ef-afd8-67d52a873390 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.397446 Aug 24 03:38:49.864531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 151/292] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:38:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:49.950610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:49.951272 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:49.962818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.965518 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.967648 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.975551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.976504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.977703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.294648 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-261915321", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:50.300592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:50.312119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bfdd1d7b-00b9-421c-9ad2-b8f22191e7e2 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1496 microversion: 2.1 time: 0.365245 Aug 24 03:38:50.313235 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 142/293] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:49 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1496 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:50.369363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] validate_networks() for None {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:50.778692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:50.780111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:50.794844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.795349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.795803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.796523 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.796987 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.797418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.050949 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:51.086983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-88e1cd3b-9bd8-4b77-963f-458d3d3fa22a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.303188 Aug 24 03:38:51.088095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 143/294] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:50 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:51.170710 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:51.171789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:51.176785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:38:51.177313 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:38:51.177784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:38:51.179007 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:38:51.179444 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:38:51.183021 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.183892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.184525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.185586 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.186404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.187101 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.215484 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.216225 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.217977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.218143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.219054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.219572 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.220915 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Going to try to terminate instance {{(pid=127259) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:51.262822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Getting quotas for project 76c2e8ca4e594275a764e2bfd287af9d. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:51.271057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Getting quotas for user ab3dbf21871d4ee284f3c155a1b70ce7 and project 76c2e8ca4e594275a764e2bfd287af9d. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:51.291259 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:38:51.294158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:38:51.370800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5f57e6c8-a71f-4ad5-9b2e-7dbafd15c8bd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "DELETE /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 204 len: 0 microversion: 2.1 time: 0.208608 Aug 24 03:38:51.372167 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 144/295] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:51 2022] DELETE /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:38:51.381875 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:51.383298 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:51.394500 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.395294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.395986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.396841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.397578 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.398698 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.406225 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-af524126-691e-4aa1-aeac-2627271ffafc tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114078 Aug 24 03:38:51.407062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 152/296] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:38:51.418987 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f1469c8b-d3a0-4171-a1a3-e67492eebc11 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:51.421737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f1469c8b-d3a0-4171-a1a3-e67492eebc11 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:51.511048 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f1469c8b-d3a0-4171-a1a3-e67492eebc11 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:51.521400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f1469c8b-d3a0-4171-a1a3-e67492eebc11 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1214 microversion: 2.1 time: 0.106927 Aug 24 03:38:51.521711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 153/297] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:51 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:51.779416 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:51.788933 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-00074645-d740-4634-be62-ff87de4a7e0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1502 microversion: 2.1 time: 0.412349 Aug 24 03:38:51.792995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 145/298] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:51 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:52.110363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:52.111603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:52.120639 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.121138 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.121577 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.122320 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.122778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.123345 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.205516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-928a465d-7268-4676-9df8-6c49249c9273 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Action: 'create', calling method: .version_select at 0x7f077c289310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-944059941", "metadata": {"Type": "work"}}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:52.305367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:52.313858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-50cc8d04-2e58-4b64-bdf6-4998b1c2309a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.208606 Aug 24 03:38:52.327002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 146/299] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:52 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:52.541445 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:52.542352 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:52.550634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.551678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.552302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.553679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.554538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.556092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.613123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-928a465d-7268-4676-9df8-6c49249c9273 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.610963 Aug 24 03:38:52.614448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 154/300] 10.222.0.91 () {60 vars in 1156 bytes} [Wed Aug 24 03:38:52 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 613 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 03:38:52.628081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5af7b8f9-a2e6-42cc-8074-92f339c6dbf5 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Calling method '.version_select at 0x7f077c272790>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:52.678009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:52.690837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-902b6f5b-407c-48d1-8039-4d8c15f73fd0 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1218 microversion: 2.1 time: 0.153554 Aug 24 03:38:52.691419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 147/301] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:52 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:52.725619 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5af7b8f9-a2e6-42cc-8074-92f339c6dbf5 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed" status: 200 len: 352 microversion: 2.1 time: 0.102817 Aug 24 03:38:52.726290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 155/302] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:38:52 2022] GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:52.815316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:52.815995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:52.823134 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.823824 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.824456 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.825378 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.826043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.826706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.982108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:52.989488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:52.995680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0602ed50-561f-4194-9109-1f07ff26df61 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1502 microversion: 2.1 time: 0.184177 Aug 24 03:38:53.011131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 148/303] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:52 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:53.335835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:53.336451 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:53.485108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:53.485520 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:53.486524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:53.487231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:53.487683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:53.488105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:53.636069 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:53.645815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0f009060-e327-43b2-a38f-30f6502d31f7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.313746 Aug 24 03:38:53.646488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 156/304] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:53 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:53.711951 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:53.712552 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:53.719734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:53.720080 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:53.721011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:53.725882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:53.725882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:53.725882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:53.739960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f78acaf4-bd51-4cbf-8513-64bd8e3cde8e tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Calling method '.version_select at 0x7f077c312430>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:53.790135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f78acaf4-bd51-4cbf-8513-64bd8e3cde8e tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed" status: 200 len: 353 microversion: 2.1 time: 0.054301 Aug 24 03:38:53.790726 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 157/305] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:38:53 2022] GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:53.800316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:53.803641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-74ba5583-fa82-4c61-92de-4b5cbfbe307c tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Calling method '.version_select at 0x7f077c312d30>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:53.809145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-06988239-2e0b-4e14-813f-420bde7bfa4f tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1266 microversion: 2.1 time: 0.100901 Aug 24 03:38:53.810440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 149/306] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:53 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:53.861713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-74ba5583-fa82-4c61-92de-4b5cbfbe307c tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed" status: 200 len: 353 microversion: 2.1 time: 0.061142 Aug 24 03:38:53.862357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 158/307] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:38:53 2022] GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:53.880485 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0d482c98-c023-4ee5-ba98-43ee40e3c45b tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Calling method '.version_select at 0x7f077c38a550>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:53.949927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0d482c98-c023-4ee5-ba98-43ee40e3c45b tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed" status: 202 len: 0 microversion: 2.1 time: 0.073677 Aug 24 03:38:53.950531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 150/308] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:38:53 2022] DELETE /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:53.959380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bb5d0a14-2434-4652-8b35-c4493898f4c0 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Calling method '.version_select at 0x7f077c272430>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:54.007566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bb5d0a14-2434-4652-8b35-c4493898f4c0 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed" status: 200 len: 352 microversion: 2.1 time: 0.052755 Aug 24 03:38:54.008125 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 159/309] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:38:53 2022] GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:54.018132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:54.018816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:54.025246 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.025873 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.027043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.027942 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.028395 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.028820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.175789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:54.185157 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-564d4272-a22c-4384-94ad-467aaa21deea tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1502 microversion: 2.1 time: 0.170843 Aug 24 03:38:54.185820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 151/310] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:54 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:54.668811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:54.670291 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:54.681070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.684566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.685283 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.686461 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.688016 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.690314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.728918 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-4e298be6-6df7-439c-9eae-2aa57dfb2d0f req-0b5a50fb-2fca-45ed-9658-bfc2a076ac99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1464a48-511e-4582-80be-aa1330f298ac", "name": "network-vif-deleted", "tag": "736b7877-c873-421f-a96b-0ec89bd67b32"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:54.748708 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-4e298be6-6df7-439c-9eae-2aa57dfb2d0f req-0b5a50fb-2fca-45ed-9658-bfc2a076ac99 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.749295 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-4e298be6-6df7-439c-9eae-2aa57dfb2d0f req-0b5a50fb-2fca-45ed-9658-bfc2a076ac99 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.749807 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-4e298be6-6df7-439c-9eae-2aa57dfb2d0f req-0b5a50fb-2fca-45ed-9658-bfc2a076ac99 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.775442 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-4e298be6-6df7-439c-9eae-2aa57dfb2d0f req-0b5a50fb-2fca-45ed-9658-bfc2a076ac99 service nova] Creating event network-vif-deleted:736b7877-c873-421f-a96b-0ec89bd67b32 for instance d1464a48-511e-4582-80be-aa1330f298ac on hv-cinder-85426 Aug 24 03:38:54.786498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-4e298be6-6df7-439c-9eae-2aa57dfb2d0f req-0b5a50fb-2fca-45ed-9658-bfc2a076ac99 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062049 Aug 24 03:38:54.788435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 152/311] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:54.835637 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:54.836770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:54.843002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.843645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.844369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.845097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.846282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.846998 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.942800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:54.955280 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-85f71e83-feb9-432f-b231-c21111137b2d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.289570 Aug 24 03:38:54.959688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 160/312] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:54 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:54.972763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:55.005227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-29d5ea20-01ea-4004-a8fc-df15b709dbbb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1272 microversion: 2.1 time: 0.176432 Aug 24 03:38:55.008324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 153/313] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:54 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:55.021264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3be7bcfd-7de7-409d-a528-8e328c91abe6 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Calling method '.version_select at 0x7f077c312040>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:55.053718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-3be7bcfd-7de7-409d-a528-8e328c91abe6 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] HTTP exception thrown: Volume ce61c0de-3525-42ed-a899-3b4d1423fbed could not be found. Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3be7bcfd-7de7-409d-a528-8e328c91abe6 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Request method failure captured: Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed HTTP/1.1 Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ1L4rhDJQQVscFd1aZvkesDP_Elz-UxjkcvQ-McvHtJkM-jrKqPK4hTr8WDR390HfbnT5UYHy3VxVAhEMlyMMZD7ufh3YUhV1O-gZywK6EMFP40GZEcMDDMtovMAgCYI_tLK2q9Ncawe6v7B1lOqeXiU9Dc72Ipp0uzOinQ8YlxSkg Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: e1243b68f22d47dca0ee1ece2aa1c9c6 Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesGetTestJSON-1484027127 Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:38:55.055801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_e1243b68f22d47dca0ee1ece2aa1c9c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e1243b68f22d47dca0ee1ece2aa1c9c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/e1243b68f22d47dca0ee1ece2aa1c9c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/e1243b68f22d47dca0ee1ece2aa1c9c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesGetTestJSON-1484027127 Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: e1243b68f22d47dca0ee1ece2aa1c9c6 Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesGetTestJSON-1484027127 Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesGetTestJSON-1484027127-project Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 5211875fe54147789e30dc6972576c1d Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesGetTestJSON-1484027127-project Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Volume ce61c0de-3525-42ed-a899-3b4d1423fbed could not be found. Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'ce61c0de-3525-42ed-a899-3b4d1423fbed'} Aug 24 03:38:55.057092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce61c0de-3525-42ed-a899-3b4d1423fbed could not be found. (HTTP 404) (Request-ID: req-550c046a-e69f-41b6-9bc9-18b7dab2281b) Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:55.057947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:38:55.059158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce61c0de-3525-42ed-a899-3b4d1423fbed could not be found. Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:38:55.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce61c0de-3525-42ed-a899-3b4d1423fbed could not be found. Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce61c0de-3525-42ed-a899-3b4d1423fbed could not be found. Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3be7bcfd-7de7-409d-a528-8e328c91abe6 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] Returning 404 to user: Volume ce61c0de-3525-42ed-a899-3b4d1423fbed could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3be7bcfd-7de7-409d-a528-8e328c91abe6 tempest-VolumesGetTestJSON-1484027127 tempest-VolumesGetTestJSON-1484027127-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed" status: 404 len: 109 microversion: 2.1 time: 0.040408 Aug 24 03:38:55.061263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 161/314] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:38:55 2022] GET /compute/v2.1/os-volumes/ce61c0de-3525-42ed-a899-3b4d1423fbed => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:55.214358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:55.217746 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:55.225806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.226662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.230958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.231936 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.232543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.233176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.276434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.276686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.277534 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.278261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lazy-loading 'fault' on Instance uuid d1464a48-511e-4582-80be-aa1330f298ac {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:55.339218 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:55.351390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2e17bbdd-f586-4b57-8d55-64871574e6e7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 200 len: 1303 microversion: 2.1 time: 0.148856 Aug 24 03:38:55.353009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 154/315] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:55 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:55.995023 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:55.995634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:56.003380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.004162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.004607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.005324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.005779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.006581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.030230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:56.032126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:56.039588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.040427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.041037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.041964 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.042843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.043508 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.179127 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:56.187547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4297a843-3f92-47f5-9cb8-953232936085 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.196481 Aug 24 03:38:56.188829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 162/316] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:55 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:56.268036 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:56.275912 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b2b68c79-2009-490a-b68b-3f65cf66afc1 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.249992 Aug 24 03:38:56.276715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 155/317] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:56 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:56.375139 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:56.375787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d1464a48-511e-4582-80be-aa1330f298ac] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:56.381842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.382308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.382738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.383704 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.384215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.384866 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.399360 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] HTTP exception thrown: Instance d1464a48-511e-4582-80be-aa1330f298ac could not be found. Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Request method failure captured: Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac HTTP/1.1 Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ0v1P40teV4JqlwPm6x4XwJwD1szl2mpsYozUBukfb0lMQ_er8253XRE1n9ha7UvLlt0g9Desu3r5XQq849zkliC9DzeBPwEVhAmutjz4TJJ8rIgiQvLqD5fmmuWNbEenW3ko0UTt70MoVYTks7rvXWzKuNR7tc4HAtOADHQVs5y90 Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 97e2f9bd5a7b4fc8828847d518968bfd Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesActionsTest-334255739 Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:38:56.401123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_97e2f9bd5a7b4fc8828847d518968bfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/97e2f9bd5a7b4fc8828847d518968bfd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/97e2f9bd5a7b4fc8828847d518968bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/97e2f9bd5a7b4fc8828847d518968bfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesActionsTest-334255739 Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 97e2f9bd5a7b4fc8828847d518968bfd Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesActionsTest-334255739 Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesActionsTest-334255739-project Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 5439318804a745d98ee897fb511ed9af Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesActionsTest-334255739-project Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance d1464a48-511e-4582-80be-aa1330f298ac could not be found. Aug 24 03:38:56.402643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'd1464a48-511e-4582-80be-aa1330f298ac'} Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1464a48-511e-4582-80be-aa1330f298ac could not be found. Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:56.403711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1464a48-511e-4582-80be-aa1330f298ac could not be found. Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1464a48-511e-4582-80be-aa1330f298ac could not be found. Aug 24 03:38:56.404900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:38:56.408817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Returning 404 to user: Instance d1464a48-511e-4582-80be-aa1330f298ac could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:56.408817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f99e52a7-4f68-4243-935f-0c7b07f107f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac" status: 404 len: 111 microversion: 2.1 time: 0.031771 Aug 24 03:38:56.408817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 163/318] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:56 2022] GET /compute/v2.1/servers/d1464a48-511e-4582-80be-aa1330f298ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:56.523510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1209810795", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "networks": [{"uuid": "abba8734-dfda-4c08-ba98-1f901a1ff528"}]}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:56.552971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-5c1d04af-7895-4c60-8589-5dd6157a58e6 req-7201c52c-8452-466d-956a-4d041439d05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80117223-e4e0-4d4f-a50b-ecea99598609", "tag": "cca4651b-bdaa-4f5e-8e13-91e21aa811e5"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:56.570219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5c1d04af-7895-4c60-8589-5dd6157a58e6 req-7201c52c-8452-466d-956a-4d041439d05b service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.570744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5c1d04af-7895-4c60-8589-5dd6157a58e6 req-7201c52c-8452-466d-956a-4d041439d05b service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.571168 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5c1d04af-7895-4c60-8589-5dd6157a58e6 req-7201c52c-8452-466d-956a-4d041439d05b service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.588539 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-5c1d04af-7895-4c60-8589-5dd6157a58e6 req-7201c52c-8452-466d-956a-4d041439d05b service nova] Creating event network-changed:cca4651b-bdaa-4f5e-8e13-91e21aa811e5 for instance 80117223-e4e0-4d4f-a50b-ecea99598609 on hv-cinder-85426 Aug 24 03:38:56.603505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-5c1d04af-7895-4c60-8589-5dd6157a58e6 req-7201c52c-8452-466d-956a-4d041439d05b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065512 Aug 24 03:38:56.604422 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 164/319] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:56.610054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] validate_networks() for [('abba8734-dfda-4c08-ba98-1f901a1ff528', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:57.210811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:57.217886 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:38:57.218485 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:38:57.219078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:38:57.219801 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:38:57.221085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:38:57.225930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:57.246718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.246967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.247428 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.247856 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.248240 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.248927 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.249103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.249736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.250231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.250504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.250902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.251471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.275468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Getting quotas for project 97e2f9bd5a7b4fc8828847d518968bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:57.281482 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Getting quotas for user 5439318804a745d98ee897fb511ed9af and project 97e2f9bd5a7b4fc8828847d518968bfd. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:57.296701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:38:57.299578 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:38:57.353172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-88461bab-255a-400b-b0e8-14a32e6465be tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833994 Aug 24 03:38:57.354258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 156/320] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:38:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:38:57.369337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:57.370092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:57.400256 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.400782 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.402537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.404349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.404827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.405218 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.430437 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:57.440148 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-36f34918-0489-4774-a8d0-fe82fb0cd0c7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.233753 Aug 24 03:38:57.454273 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 165/321] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:57 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:57.457659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a3d8dfc0-9224-4bf7-a31d-e2ab262a4a11 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:57.458449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a3d8dfc0-9224-4bf7-a31d-e2ab262a4a11 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:57.521709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a3d8dfc0-9224-4bf7-a31d-e2ab262a4a11 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:57.531899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a3d8dfc0-9224-4bf7-a31d-e2ab262a4a11 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1214 microversion: 2.1 time: 0.078645 Aug 24 03:38:57.545006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 166/322] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:57 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:57.646377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:57.655432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-871425f2-38eb-4edf-8764-d0ebbc9e346a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.292846 Aug 24 03:38:57.656357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 157/323] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:57 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:58.462134 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:58.462761 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:58.470657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.471207 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.471636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.472357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.472809 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.473256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.553464 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:58.553856 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:58.560365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.560850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.561291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.562073 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.562472 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.562897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.618247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:58.626447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-db13a227-15c1-4726-9897-225cc0d8f760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.168426 Aug 24 03:38:58.627023 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 167/324] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:58 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:58.632296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:58.640030 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d58e5195-a632-4b09-b7eb-c817a3694be0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1218 microversion: 2.1 time: 0.090899 Aug 24 03:38:58.640597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 158/325] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:58 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:58.677000 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:58.677619 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:58.685486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.686017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.686542 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.687309 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:58.687820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:58.688550 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:58.847766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:58.856841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-73b118b0-95e6-409e-a6f3-60144d616652 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.183801 Aug 24 03:38:58.857305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 168/326] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:58 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:59.648100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:59.648719 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:59.655146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.655627 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.656065 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.656751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.657209 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.657636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.660708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:59.661324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:59.667361 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.667843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.668279 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.668967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.669423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.669849 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.730798 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:59.738705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-45b1a6c5-a4c7-464e-a2a5-84118c3c7807 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1218 microversion: 2.1 time: 0.081407 Aug 24 03:38:59.739172 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 169/327] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:59 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:59.794141 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:59.802049 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f592406c-39f3-420a-ae3e-b566cb49ba8e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.157819 Aug 24 03:38:59.802648 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 159/328] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:59 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:59.877461 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:59.878061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:59.884002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.884590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.885020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.885698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.886147 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.886589 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.023388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:00.031103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c601e2d7-32fa-422d-a43e-75ff0aca5c00 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.158142 Aug 24 03:39:00.031674 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 170/329] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:59 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:00.759856 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:00.760459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:00.766941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.768044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.768473 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.769144 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.769590 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.770002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.823762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:00.824403 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:00.829123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:00.831295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.831790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.832227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.832926 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.833380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.833810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.837580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4b9d458b-d739-4800-b9a7-84b4e140cc3a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1218 microversion: 2.1 time: 0.081518 Aug 24 03:39:00.838146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 160/330] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:00 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:00.969855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:00.978156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-853e96b0-04f3-4192-bf5f-39ec8cc2d67b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.158224 Aug 24 03:39:00.978737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 171/331] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:00 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:01.053156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:01.053750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:01.059747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:01.060230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:01.060659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:01.061351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:01.061802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:01.062245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:01.205909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:01.213594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f7ed1ee9-10ab-4716-9f9b-340888c9df48 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.164292 Aug 24 03:39:01.214248 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 161/332] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:01 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:01.858478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:01.859095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:01.861414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:01.867568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:01.868096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:01.868534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:01.869244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:01.869731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:01.870333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:01.935434 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:01.944705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-41827758-634e-45ad-91a9-c8bbee96f0c0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1266 microversion: 2.1 time: 0.090038 Aug 24 03:39:01.945271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 172/333] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:01 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:01.999303 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:01.999916 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:02.006608 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.007075 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.007501 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.008172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.008617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.009031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.166400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:02.174737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a3f4da7d-3b5b-43cc-b504-1d3d2bdb03f5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.179184 Aug 24 03:39:02.175304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 162/334] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:01 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:02.240885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:02.242443 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:02.249095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.249587 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.250022 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.250743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.251198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.252255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.386645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:02.394880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5286a469-48d5-4600-95fb-d15455a4315a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.162590 Aug 24 03:39:02.395441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 173/335] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:02 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:02.964955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:02.965566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:02.972090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.972579 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.973000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.973688 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.974143 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.974599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.039751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:03.047372 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-263ec88d-047d-4a95-9a8c-2ce2c2baeede tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.086358 Aug 24 03:39:03.048187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 163/336] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:02 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:03.195905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:03.196519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:03.202583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.203068 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.203502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.204209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.205189 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.205744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.340719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:03.348811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a011100b-7eb4-4923-a377-281808c2b431 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.156770 Aug 24 03:39:03.349356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 174/337] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:03 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:03.415647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:03.416284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:03.423455 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.424494 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.424972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.425725 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.426163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.426625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.553596 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:03.564441 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-40d6800e-505b-4f5e-a059-1b24d572ece9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.152840 Aug 24 03:39:03.565011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 164/338] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:03 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:04.068724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:04.069393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:04.075396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.075881 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.076318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.077008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.077462 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.077887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.137793 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:04.145458 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-86cee05a-611c-49e9-9a14-8743dba0273a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.081295 Aug 24 03:39:04.146014 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 175/339] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:04 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:04.370543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:04.371069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:04.378118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.378638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.379077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.379776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.380237 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.380674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.518710 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:04.526417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0d74b6c1-835b-4975-9c4e-0e954a0e5408 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.159857 Aug 24 03:39:04.526981 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 165/340] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:04 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:04.584586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:04.585197 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:04.591177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.591658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.592095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.592791 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.593276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.593660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.731757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:04.739315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a38bd9ca-db57-4dd3-bb79-2e9af7ea130b tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.158557 Aug 24 03:39:04.739871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 176/341] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:04 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:05.166551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:05.166970 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:05.173291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.174433 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.174871 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.175563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.176018 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.176441 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.239674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:05.247680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-24b131fb-9fc2-4695-bc5d-8f934a676afe tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.084868 Aug 24 03:39:05.248233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 166/342] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:05 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:05.547274 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:05.547884 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:05.554944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.555429 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.555867 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.556563 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.557024 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.557456 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.573192 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:05.697986 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:05.706804 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-88f1c616-2c3e-4484-8ca5-e6ac3331172d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.163665 Aug 24 03:39:05.707380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 177/343] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:05 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:05.760809 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:05.761404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:05.768643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.769129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.769566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.770297 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:05.770754 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:05.771183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.790344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:05.912411 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:05.920288 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-72f1b228-0004-40bd-9dd3-f877899ca56c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.163256 Aug 24 03:39:05.920952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 167/344] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:05 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:06.269251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.269859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.275847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.276326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.276760 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.277443 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.277891 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.278359 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.338228 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:06.346396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-790ed152-479d-4481-8585-52f14af4fd12 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.080923 Aug 24 03:39:06.346959 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 178/345] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:06.730667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.730667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.734491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.734973 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.735406 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.736715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.737347 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.737908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.872569 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:06.881229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-02aefff5-9ec3-467c-8942-bbf4af01e743 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.157181 Aug 24 03:39:06.881808 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 168/346] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:06.943060 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.943686 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.949735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.950232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.950664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.951350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.951794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.952208 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.087643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:07.095937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-603a351a-7c7e-4aa4-9b34-618a87bda0f3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.156986 Aug 24 03:39:07.096511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 179/347] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:07.368009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:07.368621 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:07.370751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:07.371430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:07.377543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.378027 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.378514 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.379205 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.379661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.380086 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.445072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:07.452626 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b8015945-f653-43d1-be79-83548b3b533b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.088763 Aug 24 03:39:07.453163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 169/348] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:07 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:07.902625 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:07.903398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:07.905243 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=14 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:07.910580 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.911230 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.911495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.912194 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.912644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.913098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.040534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:08.048395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bbcdae04-ab4d-4758-a39e-cea00e22cc42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.149527 Aug 24 03:39:08.048955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 180/349] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:07 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:08.116894 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:08.117502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:08.123819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.124292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.124762 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.125435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.125881 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.126709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.252529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:08.259941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-27e83f48-c3c7-42fd-887b-c45bdb7dc6f9 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.146916 Aug 24 03:39:08.260488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 170/350] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:08 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:08.474214 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:08.474746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:08.481025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.481505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.481938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.482648 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.483101 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.483523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.547579 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:08.556713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ad5c4544-a937-45cc-ad85-c2a4b61378b6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.086906 Aug 24 03:39:08.557349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 181/351] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:08 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:09.068858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:09.069467 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:09.075370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.075841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.076269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.076939 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.077386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.077801 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.207009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:09.214588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-657688bc-7cc2-4483-99ad-19ded9284ae1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.149584 Aug 24 03:39:09.215177 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 171/352] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:09 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:09.280770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:09.281301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:09.288007 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.288478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.288904 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.289576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.290019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.290464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.417267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:09.425673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ab584315-6cfe-4b7b-90a5-c13255047736 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.148810 Aug 24 03:39:09.426254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 182/353] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:09 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:09.576814 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:09.577344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:09.583404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.583876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.584304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.584977 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.585430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.585849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.649213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:09.656744 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ba805271-ec9c-4804-9df3-5c5631ca99fc tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.083864 Aug 24 03:39:09.657296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 172/354] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:09 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:10.236025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.236639 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.243141 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.243141 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.244122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.244309 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.244764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.245189 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.383192 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:10.392232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d3bb3aed-c4b6-48d6-87ba-41467c525fbc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.160044 Aug 24 03:39:10.392791 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 183/355] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:10.446112 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.446763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.453245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.453724 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.454159 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.454880 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.455333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.455759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.589633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:10.598050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-81251108-0a65-4e2a-8167-02f1b2954abd tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.155733 Aug 24 03:39:10.598648 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 173/356] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:10.683692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.684699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.693829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.694358 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.694795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.695500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.696393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.777713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:10.786653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-049ed3f4-150b-4c74-89c1-7029824da121 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.113394 Aug 24 03:39:10.787232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 184/357] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:11.412994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:11.413607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:11.419823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.420316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.420754 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.421476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.421939 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.422394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.575460 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:11.585142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0652d1c7-05da-4cb9-b329-8165c97936d4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.175952 Aug 24 03:39:11.585717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 174/358] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:11 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:11.623928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:11.626757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:11.641241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.642792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.643640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.644446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.644915 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.645526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.792586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:11.803672 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0cbeb27c-a3bf-4cb0-969d-58bc53ba9d2c tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.187696 Aug 24 03:39:11.804240 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 185/359] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:11 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:11.817211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:11.817832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:11.823780 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.824265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.824705 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.825393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.825852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.826348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.893052 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:11.900818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-44081625-6cca-4e71-af20-309b164e5ed7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1284 microversion: 2.1 time: 0.087894 Aug 24 03:39:11.901390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 175/360] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:11 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:12.608219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:12.608937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:12.616796 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.617617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.618122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.619059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.619790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.620470 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.761280 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:12.770927 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-67da13f2-f7d2-4406-9be3-0ec0865a6cac tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.166884 Aug 24 03:39:12.771761 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 186/361] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:12 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:12.826508 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:12.829674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:12.836772 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.837561 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.838214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.839973 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.840768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.841614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.924021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:12.924722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:12.933840 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.934884 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.937448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.939679 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.942152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.943015 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.033533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:13.044618 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ae689b5b-fe23-41c2-a0cc-0180612dc1b1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1272 microversion: 2.1 time: 0.125230 Aug 24 03:39:13.045213 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 187/362] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:12 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:13.129593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:13.137553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-528ea5cb-f3a9-4d20-af56-385e3e8e93fb tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.316161 Aug 24 03:39:13.138721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 176/363] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:12 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:13.252879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-d485132c-0d58-4aea-936c-4bcc7cd922bf req-a6efff4d-e9da-4bb0-bd8f-6501a0d8f76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80117223-e4e0-4d4f-a50b-ecea99598609", "name": "network-vif-plugged", "status": "completed", "tag": "cca4651b-bdaa-4f5e-8e13-91e21aa811e5"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:13.265653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-d485132c-0d58-4aea-936c-4bcc7cd922bf req-a6efff4d-e9da-4bb0-bd8f-6501a0d8f76c service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.266446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-d485132c-0d58-4aea-936c-4bcc7cd922bf req-a6efff4d-e9da-4bb0-bd8f-6501a0d8f76c service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.267444 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-d485132c-0d58-4aea-936c-4bcc7cd922bf req-a6efff4d-e9da-4bb0-bd8f-6501a0d8f76c service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.287462 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-d485132c-0d58-4aea-936c-4bcc7cd922bf req-a6efff4d-e9da-4bb0-bd8f-6501a0d8f76c service nova] Creating event network-vif-plugged:cca4651b-bdaa-4f5e-8e13-91e21aa811e5 for instance 80117223-e4e0-4d4f-a50b-ecea99598609 on hv-cinder-85426 Aug 24 03:39:13.294370 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-d485132c-0d58-4aea-936c-4bcc7cd922bf req-a6efff4d-e9da-4bb0-bd8f-6501a0d8f76c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046694 Aug 24 03:39:13.295169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 188/364] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:13.792449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:13.793055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:13.799762 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.800255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.800729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.801434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.801889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.802351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.002077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.010238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-77fc12eb-fe72-4792-ad78-f607fab57cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.221516 Aug 24 03:39:14.010895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 177/365] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:13 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:14.068463 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:14.069082 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:14.076378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.076865 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.077303 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.077999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.078518 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.078946 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.159553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:14.160164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:14.167958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.168444 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.168878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.169766 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.170010 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.170453 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.221268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.228844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a3cfccf9-18e8-40f8-89a2-2f22a78037d8 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.165340 Aug 24 03:39:14.229411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 189/366] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:14 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:14.387699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.396558 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0f635930-5de6-4a5b-b857-609851477692 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.241372 Aug 24 03:39:14.410221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 178/367] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:14 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:14.580034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-1b85a442-c551-49d0-ade4-472c2f91dec0 req-4d4ea60f-d040-48d0-8f7d-3ad3b5e03aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d048e3d6-3169-4cdb-843a-eb697aa435da", "tag": "1ffe9331-a25b-4918-b73c-b0b341c40ad8"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:14.590725 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1b85a442-c551-49d0-ade4-472c2f91dec0 req-4d4ea60f-d040-48d0-8f7d-3ad3b5e03aee service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.591205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1b85a442-c551-49d0-ade4-472c2f91dec0 req-4d4ea60f-d040-48d0-8f7d-3ad3b5e03aee service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.592205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-1b85a442-c551-49d0-ade4-472c2f91dec0 req-4d4ea60f-d040-48d0-8f7d-3ad3b5e03aee service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.613545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-1b85a442-c551-49d0-ade4-472c2f91dec0 req-4d4ea60f-d040-48d0-8f7d-3ad3b5e03aee service nova] Creating event network-changed:1ffe9331-a25b-4918-b73c-b0b341c40ad8 for instance d048e3d6-3169-4cdb-843a-eb697aa435da on hv-cinder-85426 Aug 24 03:39:14.619176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-1b85a442-c551-49d0-ade4-472c2f91dec0 req-4d4ea60f-d040-48d0-8f7d-3ad3b5e03aee service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042973 Aug 24 03:39:14.620315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 190/368] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:15.032425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:15.033029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:15.039394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.039878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.040318 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.041009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.041465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.041894 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.174380 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:15.182047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ee70f178-cd43-4524-8b2b-d7d3d2735604 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1522 microversion: 2.1 time: 0.154114 Aug 24 03:39:15.182652 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 179/369] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:15 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:15.251593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:15.252319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:15.258644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.259131 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.259567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.260329 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.260757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.261179 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.400138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:15.412172 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b4570a76-39bf-450e-bb3c-8852a61b5a3f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.164766 Aug 24 03:39:15.420954 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 191/370] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:15 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:15.427186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:15.427789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:15.429739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:15.437194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.437194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.437194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.437194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.437821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.437821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.571960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:15.579877 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f3c8cec9-4f7f-4a4a-a133-da531c21c520 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.156886 Aug 24 03:39:15.580436 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 180/371] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:15 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:16.203346 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:16.203971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:16.206653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:16.211929 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.212414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.212876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.214090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.214579 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.215039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.364542 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:16.372448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e0f8e11e-74ab-4215-adba-09b58fb1076b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1502 microversion: 2.1 time: 0.172962 Aug 24 03:39:16.373069 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 192/372] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:16 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:16.393399 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:16.394017 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:16.400566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.401054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.401518 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.402254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.402714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.403204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.433311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:16.433940 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:16.441487 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.442203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.442835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.443669 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.444308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.444908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.592480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:16.601002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1e0b11d8-2f81-42ac-b1fa-c11aaaaaf52f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.171682 Aug 24 03:39:16.601574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 193/373] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:16 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:16.605985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:16.606834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:16.631971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.632469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.632903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.633605 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.634057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.634685 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.685993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:16.693868 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7483ecb4-79e3-4542-92f2-251eb1dfe417 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1515 microversion: 2.1 time: 0.304955 Aug 24 03:39:16.694469 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 181/374] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:16 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:16.772337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:16.780629 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-259a437e-114b-43d6-a6eb-8bf66b3feaec tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1314 microversion: 2.1 time: 0.178057 Aug 24 03:39:16.789212 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 194/375] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:16 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:17.622044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:17.622618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:17.629371 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:17.629851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:17.630317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:17.631004 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:17.631459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:17.631887 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:17.768855 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:17.776404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0fb5c534-e073-45ab-865f-f9afc3327eb0 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.158240 Aug 24 03:39:17.776952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 182/376] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:17 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:17.801874 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:17.802526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:17.808784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:17.809260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:17.809692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:17.810420 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:17.810875 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:17.811296 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:17.825741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:17.976122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:17.987393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5dff18fb-da3b-414f-8933-e8abe5557e04 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1463 microversion: 2.1 time: 0.190440 Aug 24 03:39:17.997582 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 195/377] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:17 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1463 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:18.041476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:18.041978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:18.047972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.048662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.049275 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.049989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.050633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.051343 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.077144 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Going to try to terminate instance {{(pid=127259) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:18.094331 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:18.160456 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-60a7f4e1-09a4-482c-a777-5fc498f4eae4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "DELETE /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 204 len: 0 microversion: 2.1 time: 0.122468 Aug 24 03:39:18.161224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 183/378] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:39:18 2022] DELETE /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:39:18.169818 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:18.170599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:18.177333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.177889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.178362 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.179051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.179528 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.180101 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.310668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:18.318325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-064eef7c-c320-4702-872c-479bdb433ac4 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1469 microversion: 2.1 time: 0.152627 Aug 24 03:39:18.318894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 196/379] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:18 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:18.798178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:18.799054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:18.804921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.805398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.805831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.806532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:18.806998 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:18.807398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:18.935022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:18.943214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c0c98fd6-13af-4d19-9455-800c67d9885b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.149924 Aug 24 03:39:18.943771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 184/380] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:18 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:19.147264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:19.149562 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:19.155724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.156207 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.156644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.157814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.158310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.158732 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.182999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.objects.instance [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lazy-loading 'flavor' on Instance uuid 1d87bb42-638e-4844-85c4-d34fdd734471 {{(pid=127260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:39:19.253370 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-96089b13-b016-4733-b733-08b3a508c6b4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471/action" status: 200 len: 32 microversion: 2.1 time: 0.110051 Aug 24 03:39:19.256301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 197/381] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:39:19 2022] POST /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:39:19.263790 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:19.264395 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:19.270990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.271469 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.271901 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.272586 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.273035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.273457 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.340505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:19.341334 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:19.347800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.348486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.348937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.349645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.350155 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.350775 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.421117 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:19.434048 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8e0b16f5-2883-4d91-96f8-23d58a4ecd66 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.174305 Aug 24 03:39:19.434718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 185/382] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:19 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:19.506230 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:19.514785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-aa0647fd-9b0d-4864-bf8e-e74cdbf3a98d tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1469 microversion: 2.1 time: 0.178859 Aug 24 03:39:19.515365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 198/383] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:19 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:19.963600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:19.964208 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:19.971274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.971762 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.972201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:19.972897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:19.973374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:19.973820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:20.104942 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:20.113634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ca370dda-0184-4f2c-92d4-bb256986f6d5 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.153840 Aug 24 03:39:20.114226 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 186/384] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:19 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:20.456073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:20.456714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:20.462693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:20.463178 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:20.463614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:20.464306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:20.464772 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:20.465189 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:20.537176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:20.537797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:20.543821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:20.544316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:20.544752 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:20.545449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:20.545905 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:20.546363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:20.606336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:20.614144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e0f6ebc5-43df-4a50-88e6-0e4cb9b52692 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.162392 Aug 24 03:39:20.614881 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 199/385] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:20 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:20.709436 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:20.717018 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-91b62949-64eb-4786-9237-c808c17a6415 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1469 microversion: 2.1 time: 0.184223 Aug 24 03:39:20.717572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 187/386] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:20 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:21.134731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:21.135406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:21.142719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:21.143497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:21.144088 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:21.145266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:21.146001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:21.146647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:21.295162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:21.303607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7daae0bd-18c7-4a99-b786-2d8d98d51818 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.173153 Aug 24 03:39:21.304247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 200/387] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:21 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:21.635168 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:21.635777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:21.643145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:21.643631 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:21.644072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:21.644761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:21.645210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:21.645632 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:21.737284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:21.737899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:21.743905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:21.744391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:21.744830 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:21.745522 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:21.745978 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:21.746437 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:21.773208 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:21.781278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-22759220-b8ad-4797-9a22-fb8fcec9bd0a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.149903 Aug 24 03:39:21.781850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 188/388] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:21 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:21.875155 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:21.883411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-413996d8-21da-4ae5-970b-0e44452b144a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1469 microversion: 2.1 time: 0.150546 Aug 24 03:39:21.883972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 201/389] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:21 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:22.324820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:22.325429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:22.332089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:22.332573 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:22.333036 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:22.333724 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:22.334178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:22.334639 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:22.464989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:22.473140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1883125c-1f1f-4be7-900b-df5ce58f65fb tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.152256 Aug 24 03:39:22.473697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 189/390] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:22 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:22.803313 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:22.803942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:22.809861 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:22.810378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:22.810810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:22.811487 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:22.811930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:22.812348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:22.904852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:22.905529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:22.912397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:22.912810 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:22.913309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:22.914012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:22.914489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:22.914910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:22.945379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:22.953856 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ff332533-94f9-43cc-849b-8818dda55a4f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.154341 Aug 24 03:39:22.955120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 202/391] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:22 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:23.056905 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:23.064867 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f0b6e0e5-276c-457b-8a02-d24369f2491a tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1469 microversion: 2.1 time: 0.163828 Aug 24 03:39:23.065440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 190/392] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:22 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:23.506802 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:23.507412 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:23.514040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:23.514504 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:23.514949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:23.515675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:23.516123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:23.517165 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:23.663090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:23.676647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5212562c-aed7-40d1-b40a-33a0c761035f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.173079 Aug 24 03:39:23.676647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 203/393] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:23 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:23.976497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:23.977118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:23.983805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:23.984322 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:23.984751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:23.985519 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:23.986527 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:23.986954 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.088388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:24.089256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:24.099128 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.099893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.100582 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.101727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.102516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.106334 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.118479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:24.126620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0aa94634-2985-4ed5-8dff-9ac6ec0e7920 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.154094 Aug 24 03:39:24.127289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 191/394] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:23 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:24.248030 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:24.256899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-70befc1e-88da-48f0-a632-a9a0f6f09ece tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1469 microversion: 2.1 time: 0.174245 Aug 24 03:39:24.257507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 204/395] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:24 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:24.696939 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:24.697541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:24.704908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.705392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.705871 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.706584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.707044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.707462 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.846288 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:24.856394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5e2662f6-40fd-465e-87eb-8bb6754f1c0f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.163222 Aug 24 03:39:24.857317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 192/396] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:24 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:25.148587 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:25.149504 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:25.159262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.159612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.160477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:25.161232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.161686 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.162115 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:25.279039 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:25.279903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:25.301796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.302593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.303416 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:25.304838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.306013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.307208 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:25.333774 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:25.351467 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-345da156-f810-4b76-9267-8099cb6ab9a5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.206548 Aug 24 03:39:25.353006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 205/397] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:25 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:25.560329 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:25.568382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-52341f6f-cbff-4347-be6a-a331291a1dd7 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1469 microversion: 2.1 time: 0.293448 Aug 24 03:39:25.568984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 193/398] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:25 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:25.854287 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1189926194", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-169979743", "security_groups": [{"name": "tempest-secgroup-smoke-324399801"}], "networks": [{"uuid": "4424f815-68bd-4856-80ef-f458c715057b"}], "block_device_mapping_v2": [{"uuid": "4d51009e-413a-4800-9f26-3d4e166c75af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:25.887655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:25.889389 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:25.911211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.911832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.912362 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:25.914940 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.915800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.916603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:26.192542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:26.194428 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] validate_networks() for [('4424f815-68bd-4856-80ef-f458c715057b', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:39:26.201186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-05596fdc-861c-4d50-9c0e-cd9863a922f3 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.327377 Aug 24 03:39:26.202100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 194/399] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:25 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:26.383181 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:26.384173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:26.390474 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:26.391046 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:26.391482 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:26.392424 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:26.392871 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:26.393295 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:26.631727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:26.643260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5e61f05c-8e69-4235-88d8-8f5243fb6242 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.264081 Aug 24 03:39:26.644253 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 195/400] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:26 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:26.656352 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:26.657651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:26.664910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:26.665598 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:26.666151 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:26.668129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:26.669361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:26.669909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:26.853155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:26.863170 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bde32e54-51ff-4945-8dd4-a31ca5bf7597 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1469 microversion: 2.1 time: 0.210714 Aug 24 03:39:26.863943 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 196/401] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:26 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:27.105255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-8877c5f2-3cb0-4579-a651-ede054887b91 req-700a4c56-9a00-4c1f-bd0d-a4cee9d44961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80117223-e4e0-4d4f-a50b-ecea99598609", "name": "network-vif-deleted", "tag": "cca4651b-bdaa-4f5e-8e13-91e21aa811e5"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:27.117492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-8877c5f2-3cb0-4579-a651-ede054887b91 req-700a4c56-9a00-4c1f-bd0d-a4cee9d44961 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.118053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-8877c5f2-3cb0-4579-a651-ede054887b91 req-700a4c56-9a00-4c1f-bd0d-a4cee9d44961 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.118596 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-8877c5f2-3cb0-4579-a651-ede054887b91 req-700a4c56-9a00-4c1f-bd0d-a4cee9d44961 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.135438 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-8877c5f2-3cb0-4579-a651-ede054887b91 req-700a4c56-9a00-4c1f-bd0d-a4cee9d44961 service nova] Creating event network-vif-deleted:cca4651b-bdaa-4f5e-8e13-91e21aa811e5 for instance 80117223-e4e0-4d4f-a50b-ecea99598609 on hv-cinder-85426 Aug 24 03:39:27.142704 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-8877c5f2-3cb0-4579-a651-ede054887b91 req-700a4c56-9a00-4c1f-bd0d-a4cee9d44961 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041409 Aug 24 03:39:27.143777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 197/402] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:39:27.223755 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:27.224782 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:27.233573 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.234301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.234699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.235629 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.236091 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.236728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.272863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:39:27.273845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:39:27.274408 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:39:27.275006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:39:27.275591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:39:27.289536 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.290698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.291313 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.292228 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.293361 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.293853 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.315245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Getting quotas for project cc4ed4d70a074b97acf12130e4b00bcb. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:27.319880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Getting quotas for user c0c89aa8c55042e7af5452f1a94318a9 and project cc4ed4d70a074b97acf12130e4b00bcb. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:27.391234 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:39:27.394123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d51009e-413a-4800-9f26-3d4e166c75af',volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:39:27.418017 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:27.431471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b2a10f1a-522d-4f68-b5b2-7452bb18684e tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.212742 Aug 24 03:39:27.432934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 198/403] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:27 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:27.564096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d5e817a6-dcc7-4fab-8779-a968e9781d77 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.713079 Aug 24 03:39:27.565406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 206/404] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:39:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:39:27.577299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8151cf20-1a10-4725-a342-a692782abba6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:27.577910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8151cf20-1a10-4725-a342-a692782abba6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:27.664998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:27.665948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:27.675834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.678727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.679384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.680281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.683225 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.683870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.684006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8151cf20-1a10-4725-a342-a692782abba6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:27.694907 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8151cf20-1a10-4725-a342-a692782abba6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1088 microversion: 2.1 time: 0.121285 Aug 24 03:39:27.696202 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 199/405] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:27 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1088 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:27.769655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-997e4ac8-8f37-41c0-b255-23f16d3d9757 req-82bc4514-deb1-4591-96a0-8bae470b323f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d048e3d6-3169-4cdb-843a-eb697aa435da", "name": "network-vif-plugged", "status": "completed", "tag": "1ffe9331-a25b-4918-b73c-b0b341c40ad8"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:27.785400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-997e4ac8-8f37-41c0-b255-23f16d3d9757 req-82bc4514-deb1-4591-96a0-8bae470b323f service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.786357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-997e4ac8-8f37-41c0-b255-23f16d3d9757 req-82bc4514-deb1-4591-96a0-8bae470b323f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.787156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-997e4ac8-8f37-41c0-b255-23f16d3d9757 req-82bc4514-deb1-4591-96a0-8bae470b323f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.801776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-997e4ac8-8f37-41c0-b255-23f16d3d9757 req-82bc4514-deb1-4591-96a0-8bae470b323f service nova] Creating event network-vif-plugged:1ffe9331-a25b-4918-b73c-b0b341c40ad8 for instance d048e3d6-3169-4cdb-843a-eb697aa435da on hv-cinder-85426 Aug 24 03:39:27.809521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-997e4ac8-8f37-41c0-b255-23f16d3d9757 req-82bc4514-deb1-4591-96a0-8bae470b323f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043364 Aug 24 03:39:27.812437 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 200/406] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:27.848329 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:27.864689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0939020f-b29d-4b53-8750-7b8a61833e09 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.203501 Aug 24 03:39:27.866043 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 207/407] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:27 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:27.885357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:27.886059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:27.893246 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.893730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.894168 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.894889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.895344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.895779 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.926267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:27.942413 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.942962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.943356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.943765 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lazy-loading 'fault' on Instance uuid 80117223-e4e0-4d4f-a50b-ecea99598609 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:39:27.992900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3dbf21871d4ee284f3c155a1b70ce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c2e8ca4e594275a764e2bfd287af9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:28.006293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b5ebc7b7-eebb-4ef1-929c-05854a9d9a99 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 200 len: 1304 microversion: 2.1 time: 0.125081 Aug 24 03:39:28.006887 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 201/408] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:27 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:28.455489 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:28.456041 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:28.472238 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.472922 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.473297 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.474215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.474922 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.475368 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.631885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:28.640456 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6eb43051-ed01-40f0-8c6f-a6d740738eba tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.189931 Aug 24 03:39:28.641069 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 208/409] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:28 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:28.716202 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:28.716840 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:28.725421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.726022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.726489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.727204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.727665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.728090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.799800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:28.814462 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3806c49b-1060-452c-be11-def5b172ac38 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1186 microversion: 2.1 time: 0.102014 Aug 24 03:39:28.815551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 202/410] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:28 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:28.899747 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:28.900492 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:28.908488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.909253 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.909902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.910778 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.911376 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.911893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.029235 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:29.029908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] [instance: 80117223-e4e0-4d4f-a50b-ecea99598609] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:29.036370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.036881 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.037300 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.038281 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.038492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.039072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.053804 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] HTTP exception thrown: Instance 80117223-e4e0-4d4f-a50b-ecea99598609 could not be found. Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Request method failure captured: Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 HTTP/1.1 Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZ1HpggTQTwyf3eQj0p6VTUKrjgbrpcEwi58rFholZaf16wDjpqBFtcTB-nwIolHWjV8W5xrOO-Mcj9lZ9sUfEk0ppjUx5ff4zX9j6rLPINKL6SF-wM79t4O8tuvmB2u4Bq05xDStLQDZ5n-pc_gFsUfUheCPT82TdkLhPz8Z7i3G8Y Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 76c2e8ca4e594275a764e2bfd287af9d Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-VolumesNegativeTest-744880359 Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:39:29.058480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_76c2e8ca4e594275a764e2bfd287af9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/76c2e8ca4e594275a764e2bfd287af9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/76c2e8ca4e594275a764e2bfd287af9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/76c2e8ca4e594275a764e2bfd287af9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-VolumesNegativeTest-744880359 Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 76c2e8ca4e594275a764e2bfd287af9d Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-VolumesNegativeTest-744880359 Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-VolumesNegativeTest-744880359-project Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: ab3dbf21871d4ee284f3c155a1b70ce7 Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-VolumesNegativeTest-744880359-project Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 80117223-e4e0-4d4f-a50b-ecea99598609 could not be found. Aug 24 03:39:29.061012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '80117223-e4e0-4d4f-a50b-ecea99598609'} Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80117223-e4e0-4d4f-a50b-ecea99598609 could not be found. Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:29.062582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80117223-e4e0-4d4f-a50b-ecea99598609 could not be found. Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80117223-e4e0-4d4f-a50b-ecea99598609 could not be found. Aug 24 03:39:29.065262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:39:29.067215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] Returning 404 to user: Instance 80117223-e4e0-4d4f-a50b-ecea99598609 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:29.067215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c6e45453-e81e-4b23-b31b-ff009796f9e3 tempest-VolumesNegativeTest-744880359 tempest-VolumesNegativeTest-744880359-project] 10.222.0.91 "GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609" status: 404 len: 111 microversion: 2.1 time: 0.034593 Aug 24 03:39:29.067215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 203/411] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:29 2022] GET /compute/v2.1/servers/80117223-e4e0-4d4f-a50b-ecea99598609 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:39:29.083658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:29.092027 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a7f14f64-5116-4b4a-bc3f-1cfa6fe3a9e2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.199142 Aug 24 03:39:29.092594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 209/412] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:28 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:29.661819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:29.662863 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:29.669030 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.669509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.669940 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.670680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.671131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.671553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.825924 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:29.834275 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-17ebd00c-df83-4c8b-92b2-b899914d07d6 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.177084 Aug 24 03:39:29.835036 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 204/413] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:29 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:29.838692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:29.839393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:29.848184 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.848677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.849419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.849990 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.850560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.851600 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.922105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:29.924812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:29.933829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-748d8715-d0aa-4d7f-9e24-e53254369ef2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1186 microversion: 2.1 time: 0.099133 Aug 24 03:39:29.934434 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 210/414] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:29 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:30.123453 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:30.124059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:30.129943 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.130629 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.131173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.131796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.132594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.133016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.271083 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:30.278808 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c07d415f-09bc-4b7b-9a5d-0ecd1b712f87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.159084 Aug 24 03:39:30.279370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 205/415] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:30 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:30.856614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:30.857221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:30.865315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.865799 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.866265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.866955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.867401 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.867821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.955617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:30.956210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:30.963071 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.963562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.964005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.964737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.965199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.965645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.017674 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.028647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-233f9630-5d15-422a-88bc-4c26ae21e9c1 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.176056 Aug 24 03:39:31.029309 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 211/416] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:30 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:31.041250 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.049537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ddcf4a7f-71b1-4a53-8989-d92ff976a19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1186 microversion: 2.1 time: 0.099261 Aug 24 03:39:31.050094 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 206/417] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:30 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1186 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:31.304321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:31.304952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:31.311008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.311482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.311909 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.312584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.313219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.314210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.460689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.468524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2605559e-f263-4d8f-9aef-42b5b791ac02 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.168958 Aug 24 03:39:31.476817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 212/418] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:31 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:32.053525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.054143 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:32.060714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.061194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.061629 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.062367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.062822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.063245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.071517 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.072131 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:32.078314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.078802 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.079870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.080559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.081012 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.081440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.146421 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:32.154722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-752f9385-b42f-4829-b472-238fdb234458 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1186 microversion: 2.1 time: 0.086679 Aug 24 03:39:32.155135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 213/419] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:32 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:32.198579 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:32.213868 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-47f269dc-421d-464d-9a5b-23902e183816 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.166102 Aug 24 03:39:32.214479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 207/420] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:32 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:32.490943 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.491464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:32.497333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.497810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.498262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.498951 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.499392 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.499808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.648028 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:32.657764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1fcb3efa-7a99-41dc-bcb6-a8726b7cb9c0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.170890 Aug 24 03:39:32.658365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 214/421] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:32 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:33.175736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:33.176336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:33.182741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.183214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.183645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.184342 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.184773 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.185191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.236068 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:33.236906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:33.248264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.248758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.249297 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.249994 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.250471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.250742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:33.250897 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.258712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fae8a502-f602-41e0-9bda-7af6f2002cc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1186 microversion: 2.1 time: 0.087122 Aug 24 03:39:33.259310 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 208/422] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:33 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:33.419629 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:33.431208 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-aeb1c6a2-4b34-4e54-af78-a71b31eda97a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.199337 Aug 24 03:39:33.432675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 215/423] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:33 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:33.681413 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:33.682062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:33.688239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.689255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.689694 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.690418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:33.690895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:33.691307 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:33.835495 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:33.843582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bd574de4-52de-4c3b-a493-2d62c1c221f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.168232 Aug 24 03:39:33.844196 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 209/424] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:33 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:34.280086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:34.280815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:34.286907 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.287975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.288733 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.289257 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.289754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.353766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:34.362081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-971fe2c1-82fa-4a0a-8695-f2d4b5ea6913 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1194 microversion: 2.1 time: 0.085760 Aug 24 03:39:34.363520 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 216/425] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:34 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:34.457960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:34.458643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:34.466110 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.466624 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.467072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.467768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.468213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.468638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.638309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:34.646529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bb9ce976-6b11-4fee-ba26-db48bb3e63ce tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.192322 Aug 24 03:39:34.647348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 210/426] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:34 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:34.864563 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:34.865281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:34.873250 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.873831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.874373 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:34.875074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:34.875712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:34.876900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.026685 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:35.034598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d4c5d2ae-134a-42e3-bcc4-9d406cd2e6f2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.174615 Aug 24 03:39:35.035167 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 217/427] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:34 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:35.383175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:35.383781 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:35.390000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.390458 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.390900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.392106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.392564 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.393097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.456556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:35.464471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6dbbcd14-a31e-405f-903f-6a844fd0d9d2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1194 microversion: 2.1 time: 0.085119 Aug 24 03:39:35.465067 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 211/428] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:35 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:35.670095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:35.671654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:35.681693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.681693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.681693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.684933 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:35.685664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:35.686162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:35.837554 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:35.846594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-037c1b51-c255-43b5-8e1d-b6c9d5d5824b tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.181317 Aug 24 03:39:35.847171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 218/429] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:35 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:36.056723 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.057340 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:36.063429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.063948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.064446 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.065155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.065617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.066049 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.206111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:36.216140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-19e0b531-f52c-4de1-b006-96cb186f4a1b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.163366 Aug 24 03:39:36.216725 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 212/430] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:36 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:36.493593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.494150 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:36.500650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.501870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.502491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.503385 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.504018 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.504611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.573323 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:36.581539 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-76989cdf-afe6-4ed6-8a70-8a5d125b9601 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1194 microversion: 2.1 time: 0.093154 Aug 24 03:39:36.582704 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 219/431] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:36 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:36.871577 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:36.873111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:36.885488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.886701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.887451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:36.888945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:36.889979 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:36.890985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:37.151349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:37.159429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c4774f46-8049-40eb-b051-3e41839e611a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.295264 Aug 24 03:39:37.160006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 213/432] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:36 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:37.240813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:37.242168 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:37.264087 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.265179 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.265936 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:37.268667 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.269360 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.270344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:37.308464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:37.326488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=6 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:37.463400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:37.473029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c357326a-db60-4df1-b098-60fd3fedf84e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.237926 Aug 24 03:39:37.473675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 220/433] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:37 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:37.603884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:37.605301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:37.617131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.617917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.618625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:37.619774 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:37.620498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:37.621197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:37.692122 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:37.837012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:37.854518 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f917e649-cec2-40bc-9238-4f8a3e2c0b2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1194 microversion: 2.1 time: 0.255178 Aug 24 03:39:37.855239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 214/434] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:37 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:38.181785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:38.182530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:38.189503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.190247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.190844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.191544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.191995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.192451 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.384098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:38.394526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cea46364-355d-4f1c-ab3d-9c9b43c7a579 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.216592 Aug 24 03:39:38.396000 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 221/435] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:38 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:38.497834 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:38.499972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:38.512758 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.513497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.519978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.521025 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.521670 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.522294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.731245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:38.740956 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-db732afa-5133-4771-bd1a-29b4a18ed9ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.247566 Aug 24 03:39:38.744728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 215/436] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:38 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:38.878263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:38.879188 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:38.886755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.887666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.888262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:38.889398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:38.890012 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:38.891323 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.019054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:39.031820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-030829de-e65c-44f9-9f4c-aad5bd7df767 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1194 microversion: 2.1 time: 0.159070 Aug 24 03:39:39.033287 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 222/437] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:38 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1194 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:39.417921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:39.418568 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:39.426130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.426878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.427325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.428031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.428480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.429111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.611833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:39.623237 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b8661f62-e7ae-4e9b-a56f-294bec9e7682 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1314 microversion: 2.1 time: 0.209207 Aug 24 03:39:39.624277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 216/438] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:39 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:39.767666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:39.768891 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:39.775777 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.776507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.777108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:39.778176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:39.778813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:39.779396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.065760 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:40.067232 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:40.076851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.077915 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.078913 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.080712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.081747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.082572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.225224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:40.237712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-06b8f4f9-6685-4e9f-9692-779e5d25f971 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1204 microversion: 2.1 time: 0.179334 Aug 24 03:39:40.238699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 217/439] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:40 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1204 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:40.516228 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:40.528352 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-28ae63d9-f4f7-45e1-96c5-8bdfdeda9f5e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.764901 Aug 24 03:39:40.529699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 223/440] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:39 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:40.650018 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:40.651309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:40.693499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.693960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.694447 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.695180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:40.695640 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:40.696065 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:40.749208 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:40.978239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:40.990499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e58c8de2-756b-4aac-989c-1965c12210fd tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1497 microversion: 2.1 time: 0.348240 Aug 24 03:39:40.991416 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 218/441] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:40 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1497 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:41.267244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:41.268611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:41.274845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:41.275349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:41.275795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:41.276521 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:41.276978 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:41.277411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:41.489137 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:41.514776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9a314493-b7ef-4d46-939b-431a51aa0c5d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1192 microversion: 2.1 time: 0.252057 Aug 24 03:39:41.517201 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 224/442] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:41 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1192 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:41.561582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:41.562634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:41.585596 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:41.586880 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:41.587896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:41.589384 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:41.590804 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:41.591340 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:41.774959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:41.786866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-dff0cccd-c74f-4aed-a876-82215487bf42 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.232506 Aug 24 03:39:41.787839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 219/443] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:41 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:42.029431 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.030039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:42.042710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.043411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.044060 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.045102 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.045845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.047520 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.082257 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:42.152405 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:42.185574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4bd7487f-8c48-49f6-9d9a-066a9024abd7 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "DELETE /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 204 len: 0 microversion: 2.1 time: 0.161859 Aug 24 03:39:42.186169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 225/444] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:39:42 2022] DELETE /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:39:42.195985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.196656 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:42.206364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.207108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.207550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.208255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.210387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.210387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.428256 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:42.436581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b02c9e61-f932-4eb2-95c0-85dc66e21235 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1503 microversion: 2.1 time: 0.245135 Aug 24 03:39:42.437155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 220/445] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:42 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:42.556790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.558175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:42.567165 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.567970 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.568727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.570349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.572019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.572602 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.815796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:42.816492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:42.834178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.835114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.836199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:42.837223 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:42.838398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:42.839100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.128744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:43.147494 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b73ca617-abba-44d9-8314-acc6eee898e5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.595002 Aug 24 03:39:43.150459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 226/446] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:42 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:43.181221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:43.191626 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3b3e7c13-4d91-4d55-9503-e46e2da1d07f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.383327 Aug 24 03:39:43.192219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 221/447] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:42 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:43.306140 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-5f54177b-f414-4605-b115-2f7091f72658 req-ac349136-ed3c-4fca-9dc8-20cfbfcd5930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6e4c30-7ab0-446f-8f76-078a95397938", "tag": "c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:43.346790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5f54177b-f414-4605-b115-2f7091f72658 req-ac349136-ed3c-4fca-9dc8-20cfbfcd5930 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.352421 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5f54177b-f414-4605-b115-2f7091f72658 req-ac349136-ed3c-4fca-9dc8-20cfbfcd5930 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.362039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5f54177b-f414-4605-b115-2f7091f72658 req-ac349136-ed3c-4fca-9dc8-20cfbfcd5930 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.389459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-5f54177b-f414-4605-b115-2f7091f72658 req-ac349136-ed3c-4fca-9dc8-20cfbfcd5930 service nova] Creating event network-changed:c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27 for instance dc6e4c30-7ab0-446f-8f76-078a95397938 on hv-cinder-85426 Aug 24 03:39:43.395688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-5f54177b-f414-4605-b115-2f7091f72658 req-ac349136-ed3c-4fca-9dc8-20cfbfcd5930 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097118 Aug 24 03:39:43.396946 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 227/448] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:43.479969 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:43.481728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:43.494301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.495309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.496198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.497545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:43.498501 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:43.499366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:43.802341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:43.822661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-96aae9a2-c37d-4de1-b7f2-55b846dfbac9 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1503 microversion: 2.1 time: 0.350027 Aug 24 03:39:43.824619 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 222/449] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:43 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1503 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:44.181672 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:44.186149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:44.201379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.208424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.209325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:44.210500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.211356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.214651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:44.229628 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:44.234278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:44.259987 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.263723 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.265183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:44.273400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.278800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.283719 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:44.538762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:44.549642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9a959aaf-0624-4462-9125-5372551359eb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.375238 Aug 24 03:39:44.554980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 228/450] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:44 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:44.855216 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:44.859765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:44.881062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.882332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.883365 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:44.884985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:44.886047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:44.887097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:45.184580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:45.197686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7da5686e-fcb4-45da-a9d7-2e88ea12a849 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.976526 Aug 24 03:39:45.200204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 223/451] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:44 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:45.450230 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:45.480679 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-666ad268-f7da-4c42-9e41-555fba4a8b8f tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1503 microversion: 2.1 time: 0.625581 Aug 24 03:39:45.481160 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 229/452] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:44 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1503 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:45.584024 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:45.584942 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:45.591544 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:45.593122 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:45.593873 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:45.594355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:45.595809 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:45.596419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:45.597280 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.035714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.045344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e9021423-67fb-4fa4-a700-6d3d7ec89bcc tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.466080 Aug 24 03:39:46.060209 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 224/453] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:45 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:46.064756 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-5f658a38-6e41-4ffc-993d-a3a1b492a852 req-4d8220ca-0a3e-4614-9d5f-f4ca2570ef58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d048e3d6-3169-4cdb-843a-eb697aa435da", "name": "network-vif-deleted", "tag": "1ffe9331-a25b-4918-b73c-b0b341c40ad8"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:46.082236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5f658a38-6e41-4ffc-993d-a3a1b492a852 req-4d8220ca-0a3e-4614-9d5f-f4ca2570ef58 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.083032 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5f658a38-6e41-4ffc-993d-a3a1b492a852 req-4d8220ca-0a3e-4614-9d5f-f4ca2570ef58 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.083877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5f658a38-6e41-4ffc-993d-a3a1b492a852 req-4d8220ca-0a3e-4614-9d5f-f4ca2570ef58 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.108870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-5f658a38-6e41-4ffc-993d-a3a1b492a852 req-4d8220ca-0a3e-4614-9d5f-f4ca2570ef58 service nova] Creating event network-vif-deleted:1ffe9331-a25b-4918-b73c-b0b341c40ad8 for instance d048e3d6-3169-4cdb-843a-eb697aa435da on hv-cinder-85426 Aug 24 03:39:46.117305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-5f658a38-6e41-4ffc-993d-a3a1b492a852 req-4d8220ca-0a3e-4614-9d5f-f4ca2570ef58 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060618 Aug 24 03:39:46.118523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 230/454] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:46.229450 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:46.230821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:46.238851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.239630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.240074 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.240787 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.241239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.241883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.513762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:46.514901 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:46.517166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:46.525617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.526106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.526573 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.527304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:46.527704 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:46.528124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:46.639367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.644984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:46.654122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a0e6e879-7770-4a84-a502-6a617a4ade45 tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1461 microversion: 2.1 time: 0.144228 Aug 24 03:39:46.656061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 231/455] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:46 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1461 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:46.674562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-115a62df-ec59-4042-9a7b-b0588de46020 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.451300 Aug 24 03:39:46.694736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 225/456] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:46 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:47.067645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:47.068424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:47.076755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.078040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.079422 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.081192 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.081937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.082937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.309811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:47.318844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e5e5fb7d-eb09-4d00-9a82-71a638806f2f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.255158 Aug 24 03:39:47.319837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 232/457] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:47 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:47.685965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:47.686612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:47.700197 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:47.701161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:47.717708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.718242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.718655 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.719361 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.719840 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.720260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.724165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.724658 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.725090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.725788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.726260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.726680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.828499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:47.829669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:47.830156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:47.830752 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lazy-loading 'fault' on Instance uuid d048e3d6-3169-4cdb-843a-eb697aa435da {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:39:47.949213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5439318804a745d98ee897fb511ed9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e2f9bd5a7b4fc8828847d518968bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:47.957896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c6771aaa-9595-4b7c-a2ce-17e948c0bd7a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 200 len: 1304 microversion: 2.1 time: 0.276722 Aug 24 03:39:47.971525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 226/458] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:47 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 1304 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:48.344305 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:48.346620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:48.370507 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:48.373791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:48.375118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:48.379020 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:48.379665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:48.380302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:48.463306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:48.485229 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8674adf8-7920-4f8c-8225-8c5fd3ec5beb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.788304 Aug 24 03:39:48.498831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 233/459] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:47 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:48.927314 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:48.941582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-99dac552-becb-42b5-a020-a6b88720eada tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.602090 Aug 24 03:39:48.944681 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 227/460] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:48 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:48.980559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:48.981258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] [instance: d048e3d6-3169-4cdb-843a-eb697aa435da] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:48.990384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:48.991076 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:48.991641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:48.992823 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:48.993981 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:48.994667 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.013295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] HTTP exception thrown: Instance d048e3d6-3169-4cdb-843a-eb697aa435da could not be found. Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Request method failure captured: Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da HTTP/1.1 Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ0v1P40teV4JqlwPm6x4XwJwD1szl2mpsYozUBukfb0lMQ_er8253XRE1n9ha7UvLlt0g9Desu3r5XQq849zkliC9DzeBPwEVhAmutjz4TJJ8rIgiQvLqD5fmmuWNbEenW3ko0UTt70MoVYTks7rvXWzKuNR7tc4HAtOADHQVs5y90 Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 97e2f9bd5a7b4fc8828847d518968bfd Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesActionsTest-334255739 Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:39:49.016923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_97e2f9bd5a7b4fc8828847d518968bfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/97e2f9bd5a7b4fc8828847d518968bfd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/97e2f9bd5a7b4fc8828847d518968bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/97e2f9bd5a7b4fc8828847d518968bfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesActionsTest-334255739 Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 97e2f9bd5a7b4fc8828847d518968bfd Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesActionsTest-334255739 Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesActionsTest-334255739-project Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 5439318804a745d98ee897fb511ed9af Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesActionsTest-334255739-project Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance d048e3d6-3169-4cdb-843a-eb697aa435da could not be found. Aug 24 03:39:49.019438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'd048e3d6-3169-4cdb-843a-eb697aa435da'} Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d048e3d6-3169-4cdb-843a-eb697aa435da could not be found. Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:49.020744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d048e3d6-3169-4cdb-843a-eb697aa435da could not be found. Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d048e3d6-3169-4cdb-843a-eb697aa435da could not be found. Aug 24 03:39:49.022106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:39:49.024983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] Returning 404 to user: Instance d048e3d6-3169-4cdb-843a-eb697aa435da could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:49.024983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e5fcb204-282a-4963-8e19-1176e4d3bf6a tempest-VolumesActionsTest-334255739 tempest-VolumesActionsTest-334255739-project] 10.222.0.91 "GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da" status: 404 len: 111 microversion: 2.1 time: 0.043691 Aug 24 03:39:49.027895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 234/461] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:48 2022] GET /compute/v2.1/servers/d048e3d6-3169-4cdb-843a-eb697aa435da => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:39:49.526821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:49.529059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:49.538019 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.538701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.539312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.540243 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.541302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.541932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:49.914047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:49.931570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d0f0b335-c594-4f33-bea5-34976423b0f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.419220 Aug 24 03:39:49.941970 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 228/462] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:49 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:49.968103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:49.969245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:49.992151 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:49.997839 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:49.999569 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.002368 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.003418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.004384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.235975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:50.244964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ddaaa136-ac51-421a-8337-fb7842208b9b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.284227 Aug 24 03:39:50.251568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 235/463] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:49 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:50.953323 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:50.955242 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:50.968638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.969766 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.970118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:50.970642 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:50.971488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:50.971488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.174516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:51.183271 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-de7256d2-4989-40c9-bad0-c829886b9b1e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.233677 Aug 24 03:39:51.193279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 229/464] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:50 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:51.276829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:51.278314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:51.287534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:51.290141 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:51.291153 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.299514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:51.300568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:51.301277 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:51.575699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:51.587231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4e070958-990a-42c3-aa3b-43f737d4f42c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.315192 Aug 24 03:39:51.588074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 236/465] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:51 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:52.222344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:52.223822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.231765 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.234786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.236061 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.237594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.238844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.239874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.460109 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:52.470543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ac619fa8-e8f9-4035-a483-e3d9ace00ac2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.256164 Aug 24 03:39:52.482223 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 230/466] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:52 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:52.609262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:52.610660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.626498 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.627288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.627900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.628784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.650507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.655323 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.838400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:52.850868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e774ff7f-8523-4123-bf15-2f765e562e9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.245468 Aug 24 03:39:52.851763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 237/467] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:52 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:53.505105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:53.507075 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:53.519388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:53.520148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:53.520776 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:53.521992 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:53.522641 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:53.523247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:53.766002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:53.786307 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-49fc15a5-0e46-4831-9ce8-6577d8c63cee tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.290663 Aug 24 03:39:53.787547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 231/468] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:53 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:53.875608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:53.876736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:53.889839 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:53.890347 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:53.890789 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:53.892205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:53.892665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:53.893090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:54.198027 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:54.211051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-26ddac15-4099-4498-a966-7aac7dac60c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.339169 Aug 24 03:39:54.212582 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 238/469] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:53 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:54.813679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:54.815253 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:54.828139 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:54.829650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:54.831055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:54.833513 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:54.835279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:54.835993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.056454 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:55.067580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-eb588640-b01c-4a78-88fb-89d0fd19a9f1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.258831 Aug 24 03:39:55.068405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 232/470] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:54 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:55.237673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:55.238490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:55.248928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.250444 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.253070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.254596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.255727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.256972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.514142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:55.534975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cd7b7d16-1fe7-4591-908e-c90434d4cb72 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.301365 Aug 24 03:39:55.539265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 239/471] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:55 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:56.113597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:56.114656 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:56.125017 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.126362 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.127108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.128064 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.128668 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.129458 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.330410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:56.347059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-23e01c3e-24bf-411a-958b-57f00830c41c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.243892 Aug 24 03:39:56.348364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 233/472] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:56 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:56.565977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:56.568051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:56.581869 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.583384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.584650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.587241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.587934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.588758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.945566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:56.954600 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e22bad46-1120-4159-b582-d967fd4c1a71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.396918 Aug 24 03:39:56.955182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 240/473] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:56 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:57.369227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:57.370271 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:57.383983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.384483 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.384978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.386012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.386309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.386970 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.615053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:57.618887 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:57.626368 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7b6409c7-a5a7-498d-824f-966787a3be52 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.260212 Aug 24 03:39:57.627506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 234/474] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:57 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:57.979236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:57.980678 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:57.988355 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.988992 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.989810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.990779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.991487 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.992072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.164576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:58.176535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-249d6b95-2877-46b4-87f4-1f5d6721b2a7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.201335 Aug 24 03:39:58.177123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 241/475] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:57 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:58.659231 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:58.660375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:58.669664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.670156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.670616 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.671435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.672063 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.673184 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.847274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:58.856189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-85a82030-1c35-4592-ab2b-e2fcadee1da0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.204897 Aug 24 03:39:58.874055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 235/476] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:58 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:59.197393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:59.198029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:59.207239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.207870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.208310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:59.209231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.209690 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.210113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:59.379645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:59.388671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-eb5b257d-20f0-48a8-9ec1-c05e9fd54c71 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.195346 Aug 24 03:39:59.389433 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 242/477] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:59 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:59.878819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:59.879460 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:59.887853 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.888741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.889244 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:59.890131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.890625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.891047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.042164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:00.051840 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2abae97c-85d1-453f-a0fa-2ec385c371db tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.178363 Aug 24 03:40:00.064052 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 236/478] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:59 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:00.328220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d08dbcd0-95d1-4f80-b39b-32f97e60f120 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Action: 'create', calling method: .version_select at 0x7f077c4cf310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1570057530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiZOIXMJ+lLLB6DJ5JGPxj7JfEfXSwslnLL9cVNfg2nUiJr0xtDqtE0KmB9m/MNY28kakhNMjD8jkuHUXjYWTRKGXsaJoDTABpFvi2EOLjwStUL9XkV07+ylTKyCgFQqA=="}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:00.345149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-d08dbcd0-95d1-4f80-b39b-32f97e60f120 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Getting quotas for project 0fe6a4ca8c984b2aa4df4c47b4c1d03b. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:00.349215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-d08dbcd0-95d1-4f80-b39b-32f97e60f120 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Getting quotas for user b9f929b986e645109db65651c8ff1502 and project 0fe6a4ca8c984b2aa4df4c47b4c1d03b. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:00.371882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d08dbcd0-95d1-4f80-b39b-32f97e60f120 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047447 Aug 24 03:40:00.372488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 243/479] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:40:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:00.413839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:00.414592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:00.423796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.424145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.424839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.425550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.426151 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.426524 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.434229 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-395711875", "imageRef": "5e44a929-0393-4019-a138-528f58a2aa4d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1570057530", "networks": [{"uuid": "25ae44d2-d998-4bd4-b79a-68369d3af9d4"}]}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:00.489489 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] validate_networks() for [('25ae44d2-d998-4bd4-b79a-68369d3af9d4', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:40:00.582043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:00.589993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fdbbef5c-616d-4a08-b38a-0e94390c6d70 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.181971 Aug 24 03:40:00.590843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 237/480] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:00 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:00.942050 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:40:00.942699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:40:00.943176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:40:00.944081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:40:00.944768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:40:00.956183 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.956748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.957372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.958203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.958667 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.959096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.976221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Getting quotas for project 0fe6a4ca8c984b2aa4df4c47b4c1d03b. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:00.980152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Getting quotas for user b9f929b986e645109db65651c8ff1502 and project 0fe6a4ca8c984b2aa4df4c47b4c1d03b. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:00.997297 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:40:00.999560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e44a929-0393-4019-a138-528f58a2aa4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:40:01.045940 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0ab225b5-ac82-4dab-a7b7-dec5be615da8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617282 Aug 24 03:40:01.046623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 244/481] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:40:01.058238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c13b96cb-ae0f-434c-9c6c-ab3098f26f55 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:01.059021 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c13b96cb-ae0f-434c-9c6c-ab3098f26f55 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:01.073599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:01.074317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:01.081488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.081980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.082495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.083182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.083646 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.084178 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.123724 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c13b96cb-ae0f-434c-9c6c-ab3098f26f55 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:01.131552 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c13b96cb-ae0f-434c-9c6c-ab3098f26f55 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1258 microversion: 2.1 time: 0.077315 Aug 24 03:40:01.132230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 238/482] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:01 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:01.243677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:01.252162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f7ba2257-dce7-400d-8e11-1536a94352c4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1501 microversion: 2.1 time: 0.182976 Aug 24 03:40:01.252766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 245/483] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:01 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:01.273077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "929d2005-9e0b-4470-8848-3bec4626de0e"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:01.275717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:01.283272 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.283767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.284233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.284977 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.285576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.285948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.310911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] HTTP exception thrown: Cannot 'attach_volume' instance 1d87bb42-638e-4844-85c4-d34fdd734471 while it is in vm_state rescued Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Request method failure captured: Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: POST /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471/os-volume_attachments HTTP/1.1 Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 74 Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzS_5Z0sC_TjWAR5UuUsSS6N-Xmad3SK7CRSIuSAYRNL7uR3byKKjlG0zlW7pk9avvW8cHFgWM7ApKI4DSC6o_h306gtHD_oXQ1re2A8G5jwylKiyVkBxfDPwq8etbqFD6yNjb07nZrGEK9f0-weChEHLkee0f9hcbv1ETzXr2SmGU Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:40:01.312510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 76c0df49fa9342778a56eae098b2f2cd Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {"volumeAttachment": {"volumeId": "929d2005-9e0b-4470-8848-3bec4626de0e"}} Aug 24 03:40:01.315191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Cannot 'attach_volume' instance 1d87bb42-638e-4844-85c4-d34fdd734471 while it is in vm_state rescued Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'server_id': '1d87bb42-638e-4844-85c4-d34fdd734471', 'body': {'volumeAttachment': {'volumeId': '929d2005-9e0b-4470-8848-3bec4626de0e'}}} Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d87bb42-638e-4844-85c4-d34fdd734471 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:01.317365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1d87bb42-638e-4844-85c4-d34fdd734471 while it is in vm_state rescued Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:01.319278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:01.321699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:01.321699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:01.321699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1d87bb42-638e-4844-85c4-d34fdd734471 while it is in vm_state rescued Aug 24 03:40:01.321699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:40:01.321699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Returning 409 to user: Cannot 'attach_volume' instance 1d87bb42-638e-4844-85c4-d34fdd734471 while it is in vm_state rescued {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:01.321699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6b9b2a6d-ecc3-4c59-bfc9-69db210db14c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045451 Aug 24 03:40:01.321699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 239/484] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:40:01 2022] POST /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:40:01.324159 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:01.324703 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:01.332127 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.333354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.334022 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.334836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.335560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.335855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.339885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:01.414544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-76f85507-121b-4527-a1a6-001f17155305 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471/action" status: 202 len: 0 microversion: 2.1 time: 0.094106 Aug 24 03:40:01.415422 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 246/485] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:40:01 2022] POST /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:01.427371 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:01.428976 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:01.440293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.440920 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.441390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.442365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.442995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.443645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.617918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:01.619354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:01.642123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.642889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.643461 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.645044 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.645721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.650731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.661258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:01.673570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b1dc22c8-74c9-41bc-850b-eff3403f7c81 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1509 microversion: 2.1 time: 0.251110 Aug 24 03:40:01.675542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 240/486] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:01 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:02.043561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:02.059910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bc3ef224-37f0-4b99-8ba5-2eb55fb5ca9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.450950 Aug 24 03:40:02.071251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 247/487] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:01 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:02.153140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:02.154851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:02.168186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.170765 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.171976 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.175328 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.177756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.178326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.272371 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:02.283919 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5f4fc8b7-28be-4d2b-8662-d26c27ad60ef tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1310 microversion: 2.1 time: 0.134720 Aug 24 03:40:02.284927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 241/488] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:02 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1310 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:02.699621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:02.700248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:02.710794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.711840 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.712890 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.715308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.716341 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.717497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:03.079127 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:03.085111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:03.086223 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:03.094759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-eb9c1f69-41b3-4819-9ffe-a2ffe374b7ce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1509 microversion: 2.1 time: 0.398781 Aug 24 03:40:03.106717 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 248/489] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:02 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:03.106837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:03.106837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:03.106837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:03.106837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:03.107180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:03.107180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:03.309563 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:03.310624 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:03.331036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:03.331539 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:03.333331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:03.335220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:03.335780 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:03.336146 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:03.378765 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:03.393102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-adf13a27-4a76-49a4-958e-755e27428098 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.312390 Aug 24 03:40:03.394374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 242/490] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:03 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:03.511406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:03.523383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1b65c0f9-647f-4345-9e73-c22411409e9f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1316 microversion: 2.1 time: 0.220980 Aug 24 03:40:03.538143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 249/491] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:03 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:03.784181 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:40:03.784700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 03:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:40:04.123751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:04.126320 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:04.136292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.137198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.137967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.140456 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.141929 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.144055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.414233 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:04.415538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:04.424245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.427034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.429965 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.433614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.434562 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.435253 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.493597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:04.505258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c9ac808e-fe69-4102-afd4-d1530ebd4cfd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1509 microversion: 2.1 time: 0.387260 Aug 24 03:40:04.505932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 243/492] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:04 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1509 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:04.545038 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:04.546051 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:04.553793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.554650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.555187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.556406 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.556947 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.557468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.705575 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:04.716679 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-403d8505-0710-4f47-a8af-a0569020472b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.306170 Aug 24 03:40:04.717268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 250/493] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:04 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:04.832368 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:04.856366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-749ddb0a-56b6-48c7-ab37-177a255bfa8c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.314346 Aug 24 03:40:04.858095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 244/494] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:04 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:05.535292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:05.535921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:05.547762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.548417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.549664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.550858 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.551510 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.551937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.742584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:05.744119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:05.748069 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:05.761008 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.762529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.768850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.769641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-09036940-e942-4bd6-88f0-9b50c67e3697 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1509 microversion: 2.1 time: 0.242171 Aug 24 03:40:05.770947 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.771599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.772193 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.772612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 251/495] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:05 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:05.882077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:05.883721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:05.897691 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.898654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.899431 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.900350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.901131 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.901912 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.959890 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:05.967767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6c3b71a9-b6b4-496b-87e2-8d766876c19e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.231273 Aug 24 03:40:05.969198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 245/496] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:05 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:06.145593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:06.161516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2d741c2d-f77f-47be-a266-018c59e073c1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.286235 Aug 24 03:40:06.167115 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 252/497] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:05 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:06.796458 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:06.797279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:06.815538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:06.816344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:06.816971 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:06.817870 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:06.818509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:06.819086 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:06.995471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:06.996393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:07.019531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.019531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.019725 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.020730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.021187 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.021607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.152281 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:07.165303 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-42a64938-daa2-4576-81f9-61634fc4411f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1509 microversion: 2.1 time: 0.372226 Aug 24 03:40:07.167269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 246/498] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:06 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1509 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:07.189397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:07.190349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:07.200010 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.202531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.203471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.206792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.207493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.210356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.408269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:07.424210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b641cc58-9e2f-4b1b-8bff-7b17e76ffa9f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.435851 Aug 24 03:40:07.431526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 253/499] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:06 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:07.475332 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:07.488181 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-db777480-3c2e-4c08-9e39-870061a61b46 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.300864 Aug 24 03:40:07.489505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 247/500] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:07 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:08.194547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:08.195993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:08.217415 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.217995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.218714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.222068 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.222961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.223719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.438090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:08.449590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-94b257a8-3026-4b2b-b571-2793f0b7f07a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1509 microversion: 2.1 time: 0.259128 Aug 24 03:40:08.464035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:08.464035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:08.464768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 254/501] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:08 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:08.470742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.472208 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.474291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.477000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.477902 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.480259 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.512194 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:08.512908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:08.523757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.524255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.524693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.528009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.528693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.529497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.784950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:08.793154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:08.795997 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ca178e97-1252-4e68-bed2-960aaa0d633c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.287994 Aug 24 03:40:08.808862 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 255/502] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:08 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:08.811482 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-34cdb765-d20f-4955-beca-1e9f73845b47 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.360664 Aug 24 03:40:08.812216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 248/503] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:08 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:09.472333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:09.472970 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:09.479190 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.479680 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.480121 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.480827 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.481285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.481711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.686107 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:09.696461 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c26ad792-04f1-4e9e-9a51-a8bdc264bb35 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1515 microversion: 2.1 time: 0.228040 Aug 24 03:40:09.697324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 256/504] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:09 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:09.825169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:09.827610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:09.836808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:09.837711 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:09.847217 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.848047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.848557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.850701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.852261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.853561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.854339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.855178 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.855512 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.856179 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.858287 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.858848 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:10.148327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:10.158685 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1bd48bb0-5011-417a-acc5-6865a746500c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.342111 Aug 24 03:40:10.172466 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 249/505] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:09 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:10.295467 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:10.314047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-483a2b89-c7d3-4434-8c8c-8fc85682cc6b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.479169 Aug 24 03:40:10.316186 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 257/506] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:09 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:11.194874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:11.195654 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:11.203683 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:11.220920 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.221932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.223177 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.224144 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.224837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.225492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.341532 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:11.351952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:11.393798 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:11.394549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=10 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:11.420623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.420623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.420623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.420623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.427290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.427290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.643000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:11.656133 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a72e8499-8341-41bd-9086-6fbcfd85e515 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.466503 Aug 24 03:40:11.657531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 250/507] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:11 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:11.664386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-497af4d5-fa13-4d14-b5b9-4ebc62861c26 req-0ba82c25-f597-4a5e-b27d-b094d3cd7e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719d0058-3b46-49ca-88e3-96546c996278", "tag": "09ae71df-f7d0-490a-a020-01bb30ef1264"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:11.718902 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-497af4d5-fa13-4d14-b5b9-4ebc62861c26 req-0ba82c25-f597-4a5e-b27d-b094d3cd7e5f service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.721471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-497af4d5-fa13-4d14-b5b9-4ebc62861c26 req-0ba82c25-f597-4a5e-b27d-b094d3cd7e5f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.722764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-497af4d5-fa13-4d14-b5b9-4ebc62861c26 req-0ba82c25-f597-4a5e-b27d-b094d3cd7e5f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.769958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-497af4d5-fa13-4d14-b5b9-4ebc62861c26 req-0ba82c25-f597-4a5e-b27d-b094d3cd7e5f service nova] Creating event network-changed:09ae71df-f7d0-490a-a020-01bb30ef1264 for instance 719d0058-3b46-49ca-88e3-96546c996278 on hv-cinder-85426 Aug 24 03:40:11.778234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-497af4d5-fa13-4d14-b5b9-4ebc62861c26 req-0ba82c25-f597-4a5e-b27d-b094d3cd7e5f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119016 Aug 24 03:40:11.783383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 251/508] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:11.908298 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:11.923502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6e938bb0-fb28-4cb8-a88f-8d4ad93b586e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.590654 Aug 24 03:40:11.924427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 258/509] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:11 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:12.685805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:12.687844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:12.698866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:12.699373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:12.699818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:12.700789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:12.701607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:12.702355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:12.933515 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-afec1818-d80a-4f43-95f9-7470444a8484 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'create', calling method: .version_select at 0x7f077c4ee700>, body: {"keypair": {"name": "tempest-keypair-877861284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1Wz6jSZsAdOHTqe8f3vFaq69usFF7ZsqDSyDLO1b/rP9aaHE5A6gk8tTRtGRD5KxxR+r2xb10R3eaIw17/lCDTxvY0SeyvIfH9PQX0z0dVDw9ME7uuygfjeHe66rbwhw=="}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:12.968380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-afec1818-d80a-4f43-95f9-7470444a8484 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Getting quotas for project 9494dfc650374d64bf4b5f46259a0171. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:12.978407 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-afec1818-d80a-4f43-95f9-7470444a8484 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Getting quotas for user 76c0df49fa9342778a56eae098b2f2cd and project 9494dfc650374d64bf4b5f46259a0171. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:12.994109 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:13.006079 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7958109b-9689-4bf6-8d21-c488bd8d8c60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.325972 Aug 24 03:40:13.018588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 252/510] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:12 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:13.018588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:13.018588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:13.023877 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.025308 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.025980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.026927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.027771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.028311 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.029021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-afec1818-d80a-4f43-95f9-7470444a8484 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.100023 Aug 24 03:40:13.030405 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 259/511] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:40:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:13.070854 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:13.262175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:13.275964 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c35d5fe6-b43a-4011-bb79-048bde3a08c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.266676 Aug 24 03:40:13.276739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 253/512] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:13 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:14.034135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:14.035691 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:14.043332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:14.044231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:14.044904 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:14.045892 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:14.046638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:14.047322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:14.244903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:14.253377 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1076a7e2-c9ab-45fc-9095-67dfbcae55d4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.223477 Aug 24 03:40:14.255374 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 260/513] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:14 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:14.301219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:14.302427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:14.325544 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:14.326603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:14.328126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:14.329695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:14.330415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:14.331078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:14.573551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:14.582029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1198962e-0cc9-4c39-9916-5986f6a06fe5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.288308 Aug 24 03:40:14.591807 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 254/514] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:14 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:15.185364 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1029419280", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbe77abb-36a6-4ffd-9ff5-0dda975dc89a"}], "security_groups": [{"name": "tempest-securitygroup--443111993"}], "key_name": "tempest-keypair-877861284", "user_data": "}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:15.285021 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:15.285832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:15.302806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.307648 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.311644 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.313895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.314815 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.320064 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.614135 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:15.624192 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-063f6265-157f-4bcc-9854-7a583092bde2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.351617 Aug 24 03:40:15.624777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 255/515] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:15 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:15.629589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:15.630429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:15.637927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=68 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:15.640215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.641066 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.641697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.642704 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.643131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.643560 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.836784 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:15.846463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fc3725a7-1a17-4958-97a1-8aa7ec266de3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.220283 Aug 24 03:40:15.847219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 256/516] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:15 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:16.645548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:16.646378 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:16.653179 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.653892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.654530 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.655472 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.656089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.657418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.832080 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:16.840283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c3860036-2d64-4fed-85f4-00e83da29245 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.199267 Aug 24 03:40:16.841161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 257/517] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:16 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:16.869195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:16.869733 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:16.877616 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.878178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.878818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.879529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.879993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.880421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.045422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:17.055279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4d6f2d53-9ead-4f64-905d-30202c59af75 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.190254 Aug 24 03:40:17.058556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 258/518] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:16 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:17.864756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:17.865497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:17.887509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.891633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.892346 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.893400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.900193 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.900835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:18.190095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:18.210338 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0418c0e2-0b5d-47c4-bd70-f1b748be9e26 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.352286 Aug 24 03:40:18.226510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 259/519] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:17 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:18.244295 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:18.245675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:18.269593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:18.275993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:18.276997 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:18.277911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:18.283753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:18.290438 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:18.525554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:18.543258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f5863f74-7c0b-4210-87b2-ebe0f0d551de tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.327122 Aug 24 03:40:18.550229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 260/520] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:18 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:19.245524 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:19.246581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:19.265775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.267086 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.267908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.268827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.269312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.269730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.470823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:19.478809 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8cf6dea4-5f91-4870-9ee7-392d662778ad tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.247205 Aug 24 03:40:19.479742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 261/521] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:19 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:19.533841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] validate_networks() for [('cbe77abb-36a6-4ffd-9ff5-0dda975dc89a', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:40:19.565457 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:19.566373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:19.576769 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.577258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.577693 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.578968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.579430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.579851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.732760 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:19.742150 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ae0ff31e-fea4-4e57-8d38-1623b2a247d4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.181263 Aug 24 03:40:19.742424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:19.743129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 262/522] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:19 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:19.944953 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:40:19.945383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:40:19.945871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:40:19.946305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:40:19.946723 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:40:19.956985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.957471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.957912 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.958721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.959179 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.959604 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.979559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Getting quotas for project 9494dfc650374d64bf4b5f46259a0171. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:19.984102 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Getting quotas for user 76c0df49fa9342778a56eae098b2f2cd and project 9494dfc650374d64bf4b5f46259a0171. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:19.996347 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:40:19.998702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:40:20.050884 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-989dea9d-cd84-4b90-b47b-8db3a1bc0204 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.868973 Aug 24 03:40:20.057550 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 261/523] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:40:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 4872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:40:20.064515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-58defcbc-705c-4f6e-8ad3-0a0dda586fd6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:20.065318 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-58defcbc-705c-4f6e-8ad3-0a0dda586fd6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:20.129739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-58defcbc-705c-4f6e-8ad3-0a0dda586fd6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:20.137164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-58defcbc-705c-4f6e-8ad3-0a0dda586fd6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1245 microversion: 2.1 time: 0.077874 Aug 24 03:40:20.137789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 263/524] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:20 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:20.503549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:20.504326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:20.513094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.514762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.517724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:20.523417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.524731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.525574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:20.710926 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:20.722153 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-73028d51-c70e-4d13-9473-334cd341f3b5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.224148 Aug 24 03:40:20.723036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 262/525] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:20 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:20.768189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:20.768944 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:20.775476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.776058 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.777719 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:20.778421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.779277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.779892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.000254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:21.020828 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a3e26e0b-69d3-4685-b471-b85dbe8a7d81 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.257420 Aug 24 03:40:21.033891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 264/526] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:20 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:21.162320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:21.163203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:21.169511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.169991 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.170630 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.171459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.171963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.173065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.191607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:21.241795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:21.249955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4338d9c5-3bdd-49b3-a812-54cfb741c38b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1249 microversion: 2.1 time: 0.094311 Aug 24 03:40:21.251166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 263/527] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:21 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:21.747340 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:21.748288 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:21.754886 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.755371 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.755804 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.756499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.756951 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.757375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.898246 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:21.906016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ed3c6a64-a863-431d-b605-f68310e87c7b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.162526 Aug 24 03:40:21.906642 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 265/528] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:21 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:22.041637 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:22.042174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:22.049447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:22.050202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:22.050641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:22.051335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:22.051785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:22.052206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:22.213001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:22.223112 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-adf3b5f3-61e9-4a3b-b829-7a7c95c0343a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.185249 Aug 24 03:40:22.224061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 264/529] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:22 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:22.272452 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:22.273273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:22.279637 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:22.280241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:22.280790 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:22.282116 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:22.282889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:22.283508 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:22.352116 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:22.360584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7513a339-2133-44ff-a6de-853dbe18833c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1249 microversion: 2.1 time: 0.091356 Aug 24 03:40:22.362246 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 266/530] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:22 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:22.928822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:22.929964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:22.936959 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:22.937914 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:22.938834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:22.940329 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:22.941343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:22.942128 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:23.108040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:23.118134 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6c895ea5-0f8d-49c0-8f14-6f6d96e25960 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.194036 Aug 24 03:40:23.118906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 265/531] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:22 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:23.245019 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:23.245858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:23.253315 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:23.254054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:23.254698 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:23.255398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:23.257884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:23.258626 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:23.383102 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:23.383750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:23.391824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:23.398892 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:23.399476 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:23.401220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:23.401652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:23.402471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:23.428744 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:23.440364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-abb1e4dd-dc3f-40fb-b236-9ee5f63c5f50 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.199403 Aug 24 03:40:23.446517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 267/532] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:23 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:23.487854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:23.497427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1e35a36a-4790-4135-b2b1-71a648300455 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1249 microversion: 2.1 time: 0.118676 Aug 24 03:40:23.510844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 266/533] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:23 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1249 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:24.140738 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:24.142169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:24.148319 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.149009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.149441 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.150244 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.150715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.151140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.316619 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:24.324961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9acd0b00-acfc-4579-808a-dd4ab62ca3d0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.188404 Aug 24 03:40:24.325658 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 268/534] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:24 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:24.462237 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:24.463657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:24.470233 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.470903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.471504 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.472367 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.472819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.473453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.520665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:24.521995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:24.530836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.531565 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.533179 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.535112 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:24.535808 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:24.536605 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:24.610852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:24.622226 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d495f00a-c711-4c5f-9ca2-8eb85e9f7e50 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1249 microversion: 2.1 time: 0.106994 Aug 24 03:40:24.624031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 269/535] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:24 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1249 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:24.898152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:24.911729 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bf2550f1-5dde-4272-99f9-61b9a052a300 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.453363 Aug 24 03:40:24.913336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 267/536] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:24 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:25.346693 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:25.347678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:25.354270 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.354709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.355146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.355838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.356295 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.356723 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.499390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:25.507549 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a55c56f6-9e1c-4639-a180-72a38ed28ca3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.165003 Aug 24 03:40:25.508115 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 270/537] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:25 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:25.644224 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:25.644970 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:25.650850 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.651330 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.651765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.652674 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.653202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.653322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.718584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:25.727329 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4fc39baf-5368-45b2-84de-bb1be3245456 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1249 microversion: 2.1 time: 0.087688 Aug 24 03:40:25.727915 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 268/538] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:25 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:25.935715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:25.936341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:25.942995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.943478 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.943908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.944592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:25.945202 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:25.945784 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:25.949847 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:26.095209 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:26.103862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-aeaa8f64-a8dd-41d1-b332-2e7b779feca0 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.171971 Aug 24 03:40:26.104417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 271/539] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:25 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:26.528144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:26.529092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:26.536444 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:26.536938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:26.537466 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:26.538099 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:26.538584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:26.539006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:26.678018 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:26.685812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e42b5ac8-2738-4804-a4c0-c02527d4d174 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.161774 Aug 24 03:40:26.686598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 269/540] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:26 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:26.748272 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:26.748872 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:26.757438 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:26.758341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:26.759104 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:26.760367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:26.761162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:26.761859 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:26.845352 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:26.854351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8519a146-df73-4f67-8a46-8a32c8588a17 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1249 microversion: 2.1 time: 0.109813 Aug 24 03:40:26.868187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 272/541] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:26 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1249 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:27.125680 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:27.126599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:27.133609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.134422 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.135111 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.136017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.136883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.137501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.364044 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:27.375967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6c43bc2b-5f50-4e5e-b6f8-e9d868dcdbd3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.253894 Aug 24 03:40:27.376840 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 270/542] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:27 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:27.710506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:27.711269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:27.741386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.744989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.748930 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.750814 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.753496 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.756312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.878298 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:27.878826 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:27.886575 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.887315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.887922 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:27.888800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:27.889416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:27.890020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:28.030140 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:28.039268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e8b920ff-76fe-4ec3-bb3f-4514439b32a3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1315 microversion: 2.1 time: 0.166831 Aug 24 03:40:28.039862 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 271/543] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:27 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:28.335570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:28.349317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fbcae01e-f84c-4b5c-b224-7efdecef3393 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.645850 Aug 24 03:40:28.353511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 273/544] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:27 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:28.398719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:28.399335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:28.406233 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:28.406750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:28.407193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:28.407895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:28.408353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:28.408787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:28.754129 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:28.764414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2548ecee-6bbd-494d-afb3-a8bff25f889d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.368918 Aug 24 03:40:28.766490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 272/545] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:28 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:29.064173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:29.064791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:29.080175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:29.081034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:29.081542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.082635 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:29.083313 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:29.083977 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.272212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:29.281268 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bf42ee7b-da23-474e-acc5-46887f05cb86 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.223639 Aug 24 03:40:29.282392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 274/546] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:29 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:29.370929 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:29.371533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:29.378865 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:29.379433 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:29.379983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.380773 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:29.381320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:29.381844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.515640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:29.523904 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-55af05f1-6913-494e-9583-a8a017200fd1 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.156956 Aug 24 03:40:29.524489 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 273/547] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:29 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:29.789012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:29.790354 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:29.797089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:29.797584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:29.798024 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.798763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:29.799221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:29.799662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:29.936045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:29.945031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-74da52ac-c80b-4fec-bbe0-0452515f90b2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.159945 Aug 24 03:40:29.945680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 275/548] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:29 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:30.131498 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-c931b6c8-a273-49ae-839c-c18905826993 req-b953dcef-b4fd-427d-a763-dd51a199afd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6e4c30-7ab0-446f-8f76-078a95397938", "name": "network-vif-plugged", "status": "completed", "tag": "c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:30.145271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:30.146889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=10 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:30.149219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c931b6c8-a273-49ae-839c-c18905826993 req-b953dcef-b4fd-427d-a763-dd51a199afd4 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.149918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c931b6c8-a273-49ae-839c-c18905826993 req-b953dcef-b4fd-427d-a763-dd51a199afd4 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.150574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c931b6c8-a273-49ae-839c-c18905826993 req-b953dcef-b4fd-427d-a763-dd51a199afd4 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.167121 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-c931b6c8-a273-49ae-839c-c18905826993 req-b953dcef-b4fd-427d-a763-dd51a199afd4 service nova] Creating event network-vif-plugged:c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27 for instance dc6e4c30-7ab0-446f-8f76-078a95397938 on hv-cinder-85426 Aug 24 03:40:30.174317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-c931b6c8-a273-49ae-839c-c18905826993 req-b953dcef-b4fd-427d-a763-dd51a199afd4 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046695 Aug 24 03:40:30.176086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 274/549] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:30.305182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:30.305958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:30.309079 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:30.316502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.317058 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.317670 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.318515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.319044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.319535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.459451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:30.467370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-814d940d-8d47-4045-889d-efc2792b2ab3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.167266 Aug 24 03:40:30.467864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 276/550] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:30 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:30.546074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:30.546829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:30.553956 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.554471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.554906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.555590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.556036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.556456 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.691470 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:30.699854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-74335f1f-66c9-4d43-b3cc-fcc25a06935b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.157919 Aug 24 03:40:30.700600 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 275/551] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:30 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:30.970109 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:30.970754 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:30.977665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.978204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.978642 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:30.979363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:30.979819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:30.980244 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:31.115413 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:31.123088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9c57d1d2-a331-4524-98fa-9f2b65d4f7c9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.157456 Aug 24 03:40:31.123647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 277/552] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:30 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:31.488849 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:31.489795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:31.501545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:31.501545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:31.501545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:31.501545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:31.501963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:31.501963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:31.653541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:31.663970 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1ffcf82f-48da-4953-b688-64b4f84aeb11 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.180148 Aug 24 03:40:31.664543 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 276/553] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:31 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:31.721620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:31.722255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:31.728630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:31.729106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:31.729533 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:31.730231 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:31.730680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:31.731098 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:31.866411 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:31.874120 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7ed81516-9b96-47f1-8e27-87d81170801e tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.157074 Aug 24 03:40:31.874704 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 278/554] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:31 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:32.144414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:32.145223 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:32.151624 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.152105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.152535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.153215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.153735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.154396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.291140 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:32.298867 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e9f5896b-fd91-411d-9662-3632dc582c0a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.158660 Aug 24 03:40:32.299436 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 277/555] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:32 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:32.689900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:32.694414 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:32.711636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.712220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.712612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.713639 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.714325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.714753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.895640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:32.896414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:32.902767 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.903356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.903864 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.904644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:32.905171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:32.905745 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:32.939158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:32.948522 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-15543748-3cc4-49eb-9697-219f7eb90dfa tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.267023 Aug 24 03:40:32.949790 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 279/556] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:32 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:33.057930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:33.065591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bf0affb4-11e2-42f3-aacb-697bc4bc0b8f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.174396 Aug 24 03:40:33.066166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 278/557] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:32 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:33.174945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-3cf6b5c1-8a57-4213-bbcf-57656ab76672 req-aa297927-faa8-4bd3-8bcd-57248f891914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6560bb95-66b1-4d4f-a87b-4bc63cd92674", "tag": "38238e64-0e40-4fe3-b325-5d4013cfe9ab"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:33.191299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3cf6b5c1-8a57-4213-bbcf-57656ab76672 req-aa297927-faa8-4bd3-8bcd-57248f891914 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.192131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3cf6b5c1-8a57-4213-bbcf-57656ab76672 req-aa297927-faa8-4bd3-8bcd-57248f891914 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.192341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3cf6b5c1-8a57-4213-bbcf-57656ab76672 req-aa297927-faa8-4bd3-8bcd-57248f891914 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.205175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-3cf6b5c1-8a57-4213-bbcf-57656ab76672 req-aa297927-faa8-4bd3-8bcd-57248f891914 service nova] Creating event network-changed:38238e64-0e40-4fe3-b325-5d4013cfe9ab for instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 on hv-cinder-85426 Aug 24 03:40:33.209980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-3cf6b5c1-8a57-4213-bbcf-57656ab76672 req-aa297927-faa8-4bd3-8bcd-57248f891914 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039204 Aug 24 03:40:33.210609 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 280/558] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:33.320266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:33.320870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:33.326975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.327448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.327880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.328555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.328999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.329449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.467011 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:33.474813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3c14b590-e8ff-4147-b6ee-24a1983dbb9c tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.158395 Aug 24 03:40:33.475380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 279/559] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:33 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:33.972442 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:33.973159 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:33.980229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.980725 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.981164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:33.981874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:33.982373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:33.982805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:34.087032 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:34.087749 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:34.094640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:34.095944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:34.096416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:34.097348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:34.097817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:34.098398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:34.124245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:34.132043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3e80f58b-0667-4640-8923-2e121eec63f8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.165296 Aug 24 03:40:34.132603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 281/560] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:33 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:34.229712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:34.232683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:34.238864 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e46a49a3-9176-4a57-9c08-e9c3972bb835 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.155747 Aug 24 03:40:34.239443 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 280/561] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:34 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:34.495287 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:34.495806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:34.501656 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:34.502128 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:34.502588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:34.503270 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:34.503714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:34.504132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:34.632876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:34.640423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-76164314-76f7-41a8-a8b6-79d4778c9f3b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.149067 Aug 24 03:40:34.640991 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 282/562] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:34 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:35.152930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:35.153545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:35.162128 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.162649 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.163098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.163841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.164561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.164717 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.259398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:35.259932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:35.266338 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.267396 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.267849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.268602 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.269058 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.269504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.299986 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:35.308175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cf01b418-56b0-4279-8166-d9935bf58464 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.159124 Aug 24 03:40:35.308758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 281/563] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:35 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:35.404568 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:35.412888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-754b95b7-1b0c-4459-bb8c-1856a9d91ed2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.157385 Aug 24 03:40:35.413451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 283/564] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:35 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:35.661472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:35.662250 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:35.668203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.668674 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.669104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.669779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:35.670249 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:35.670666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:35.808770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:35.817279 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-521f20eb-29bd-4052-a042-7df43cb137ba tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.160240 Aug 24 03:40:35.818035 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 282/565] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:35 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:36.329204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:36.330453 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:36.336946 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.337431 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.337870 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.338591 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.339047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.339475 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.432739 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:36.433350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:36.439828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.440310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.440745 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.441447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.441979 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.442362 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.467031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:36.475260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-16825915-9e4b-43e9-bd29-7cb19b3ed684 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.149921 Aug 24 03:40:36.475838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 284/566] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:36.569117 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:36.577133 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a0691c61-50a3-4bde-93c7-bc8d2d2390d8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.148257 Aug 24 03:40:36.577688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 283/567] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:36.839137 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:36.839786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:36.847080 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.847572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.848010 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.848709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:36.849163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:36.849592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:36.988197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:36.995817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-99dc47a5-4393-4310-ad90-f934ef24465e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.160646 Aug 24 03:40:36.996398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 285/568] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:37.496305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:37.496917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:37.503532 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:37.504005 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:37.504435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:37.505140 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:37.505588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:37.506004 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:37.598785 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:37.599402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:37.606251 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:37.606738 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:37.607186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:37.608095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:37.608563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:37.608995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:37.645007 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:37.652940 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-fadb241e-6c75-421e-9eff-140db3800500 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.160393 Aug 24 03:40:37.653518 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 284/569] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:37 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:37.763554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:37.772391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5c46a3d4-99e1-47ca-93f8-9288864ce635 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.178749 Aug 24 03:40:37.772984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 286/570] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:37 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:38.017758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:38.018439 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:38.027036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.027544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.028004 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.029189 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.029420 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.039601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.301829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.313328 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-360c2645-8150-4a37-929b-ecb29070d444 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.299891 Aug 24 03:40:38.314601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 285/571] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:38 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:38.674960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:38.675829 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:38.684920 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.685712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.686294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.687148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.687747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.688300 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.796116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:38.796116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:38.803393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.803887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.804325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.805043 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:38.805493 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:38.805920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:38.840476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.849751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-996faa68-1d0a-477e-a097-b2742102b709 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.179417 Aug 24 03:40:38.850262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 287/572] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:38 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:38.944938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:38.952655 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ff831e9e-3e85-435d-a419-5f26def9393d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.163190 Aug 24 03:40:38.953364 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 286/573] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:38 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:39.337266 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:39.337864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:39.344303 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:39.344799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:39.345780 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:39.346609 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:39.347069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:39.347497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:39.367336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:39.499613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:39.507986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e5a1254b-8a01-44bc-af17-d576f6a90ec4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.174500 Aug 24 03:40:39.508555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 288/574] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:39 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:39.870676 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:39.871294 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:39.878974 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:39.879471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:39.879917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:39.880632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:39.881093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:39.881527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:39.978525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:39.980108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:39.988640 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:39.989238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:39.989892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:39.990783 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:39.991577 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:39.992211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.029251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.038048 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3b1ce46f-1d19-4b76-8cac-1af9194654c5 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.171358 Aug 24 03:40:40.038676 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 287/575] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:39 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:40.137816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.146773 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f851e46b-b9c3-41ca-8a44-3e777830721a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.174995 Aug 24 03:40:40.147342 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 289/576] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:39 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:40.529052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:40.529656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:40.537752 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.538271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.538716 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.539438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:40.539890 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:40.540315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:40.685063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:40.693094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-39848ac8-7c6a-4309-8e1b-b813df79d9ea tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.167878 Aug 24 03:40:40.693679 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 288/577] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:40 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:41.059909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:41.060515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:41.067185 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.067699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.068146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.068838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.069293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.069715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.168284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:41.168960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:41.182216 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.182216 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.182216 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.182216 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.182882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.182882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.224750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:41.234252 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-807490de-cc1a-4d96-88af-dffa34942ba6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.177939 Aug 24 03:40:41.235169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 290/578] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:41 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:41.343809 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:41.352143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-eadcbdd1-30dc-4cd2-a80f-e93119c57c81 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.187670 Aug 24 03:40:41.352724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 289/579] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:41 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:41.716173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:41.716802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:41.722794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.723273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.723709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.724391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:41.724841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:41.725262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:41.856972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:41.865444 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-be539220-c508-4f03-a9ef-525b25771d89 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.152851 Aug 24 03:40:41.866451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 291/580] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:41 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:42.267502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:42.268040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:42.273994 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.274502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.274935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.275619 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.276071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.276492 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.375666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:42.376967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:42.383053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.383534 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.383971 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.384668 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.385125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.385548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.406077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:42.414491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-16717e8a-da7f-460b-a369-a4ba9f67dcd3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.150882 Aug 24 03:40:42.415092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 290/581] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:42 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:42.516707 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:42.524239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e3b5f7bf-36a5-4c5a-b3b1-349e89769a60 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.152377 Aug 24 03:40:42.524747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 292/582] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:42 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:42.890540 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:42.890540 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:42.895193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.895822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.896372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:42.897132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:42.897652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:42.898235 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:43.036896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:43.045643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ffad7c0d-fdce-4702-9c1f-f897a7cf348d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.162167 Aug 24 03:40:43.046244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 291/583] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:42 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:43.435837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:43.436381 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:43.443699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:43.444189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:43.444625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:43.445322 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:43.445777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:43.446226 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:43.545502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:43.546213 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:43.553589 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:43.554148 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:43.554680 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:43.555519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:43.556055 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:43.557208 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:43.589653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:43.598160 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-545f2c67-eed8-4e4e-8bb2-c9dacadbd9f0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.166284 Aug 24 03:40:43.598770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 293/584] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:43 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:43.689488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:43.699337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-060b0a0e-b11d-4e65-aec2-de5efb32062f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.157611 Aug 24 03:40:43.700265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 292/585] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:43 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:44.067551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:44.068334 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:44.074421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.074905 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.075337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.076023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.076470 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.076893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.161142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-0a429771-81b5-4fa8-95c8-1c2c9afb0214 req-e7ea155d-26b7-412e-886a-28661c65f156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719d0058-3b46-49ca-88e3-96546c996278", "name": "network-vif-plugged", "status": "completed", "tag": "09ae71df-f7d0-490a-a020-01bb30ef1264"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:44.170801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-0a429771-81b5-4fa8-95c8-1c2c9afb0214 req-e7ea155d-26b7-412e-886a-28661c65f156 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.171282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-0a429771-81b5-4fa8-95c8-1c2c9afb0214 req-e7ea155d-26b7-412e-886a-28661c65f156 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.171703 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-0a429771-81b5-4fa8-95c8-1c2c9afb0214 req-e7ea155d-26b7-412e-886a-28661c65f156 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.184622 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-0a429771-81b5-4fa8-95c8-1c2c9afb0214 req-e7ea155d-26b7-412e-886a-28661c65f156 service nova] Creating event network-vif-plugged:09ae71df-f7d0-490a-a020-01bb30ef1264 for instance 719d0058-3b46-49ca-88e3-96546c996278 on hv-cinder-85426 Aug 24 03:40:44.192274 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-0a429771-81b5-4fa8-95c8-1c2c9afb0214 req-e7ea155d-26b7-412e-886a-28661c65f156 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035140 Aug 24 03:40:44.193415 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 293/586] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:40:44.229020 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:44.237698 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-29aee99f-7151-418f-833a-0ae6c304a03f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1259 microversion: 2.1 time: 0.173916 Aug 24 03:40:44.238118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 294/587] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:44 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:44.620401 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:44.621093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:44.627723 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.628198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.628631 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.629314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.629766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.630214 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.721102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:44.722359 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:44.728694 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.729170 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.729605 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.730321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:44.730773 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:44.731201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:44.765305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:44.771423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-20bf5416-fb17-47a6-a5fd-5a5b50ffc340 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.155244 Aug 24 03:40:44.772076 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 294/588] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:44 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:44.874919 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:44.882556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d6487b04-1c49-4718-b817-65e9328e4f77 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.165536 Aug 24 03:40:44.883120 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 295/589] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:44 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:45.258432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:45.259045 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:45.265176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.265855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.266315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.267631 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.268104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.268500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.496987 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.505227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-53f7bef9-bf3f-40cc-a108-4812f4c39131 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1443 microversion: 2.1 time: 0.250770 Aug 24 03:40:45.505799 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 295/590] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:45 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1443 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:45.526978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:45.527594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:45.534827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.535317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.535791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.536516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.536965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.537454 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.730351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:45.739662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0ae5c18f-8a0e-42fb-b15d-6690f84d1602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1443 microversion: 2.1 time: 0.216833 Aug 24 03:40:45.740647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 296/591] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:45 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1443 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:45.793689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:45.794930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:45.804792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.805282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.807389 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.808258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.808878 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.809304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.906103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:45.907194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:45.910617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=84 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:45.917369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.917960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.918506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:45.919284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:45.919816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:45.920326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:46.179053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:46.188057 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d02bc2be-3c74-4699-8270-ea59b4d1d26b tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.287225 Aug 24 03:40:46.191065 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 297/592] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:45 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:46.225475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:46.240771 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-698bf5f3-a046-417b-8b1f-35c5bb8fb2ef tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.449594 Aug 24 03:40:46.241775 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 296/593] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:45 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:47.225473 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:47.226058 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:47.236747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.237487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.237713 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.240612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.241065 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.247345 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.265485 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:47.266034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:47.278129 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.281581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.283389 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.284105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.286212 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.286659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.451734 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:47.460750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-26d916c7-d1b5-494f-af5d-a7016f0ca729 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.199518 Aug 24 03:40:47.461435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 297/594] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:47 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:47.564107 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:47.571807 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7d0e65d8-5ea5-40ac-a537-679eecbf770c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.350100 Aug 24 03:40:47.572601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 298/595] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:47 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:47.959747 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-bc04ccb0-5eb3-41c8-8ea2-4719f0d5098a req-c008126f-3694-4f44-b3af-abb7b2934356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6e4c30-7ab0-446f-8f76-078a95397938", "tag": "c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:47.969264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bc04ccb0-5eb3-41c8-8ea2-4719f0d5098a req-c008126f-3694-4f44-b3af-abb7b2934356 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.970547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bc04ccb0-5eb3-41c8-8ea2-4719f0d5098a req-c008126f-3694-4f44-b3af-abb7b2934356 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.970934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bc04ccb0-5eb3-41c8-8ea2-4719f0d5098a req-c008126f-3694-4f44-b3af-abb7b2934356 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.973827 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:47.984782 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-bc04ccb0-5eb3-41c8-8ea2-4719f0d5098a req-c008126f-3694-4f44-b3af-abb7b2934356 service nova] Creating event network-changed:c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27 for instance dc6e4c30-7ab0-446f-8f76-078a95397938 on hv-cinder-85426 Aug 24 03:40:47.990078 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-bc04ccb0-5eb3-41c8-8ea2-4719f0d5098a req-c008126f-3694-4f44-b3af-abb7b2934356 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033889 Aug 24 03:40:47.990748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 298/596] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:48.485694 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:48.487002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:48.493756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.494283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.494728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.495484 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.495946 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.497057 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.593312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:48.594336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:48.604877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.605650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.606601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.607492 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.608116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.608706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.660581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:48.670507 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-046b22f9-30b5-48b0-b73e-54c0d9753ef8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.189454 Aug 24 03:40:48.671628 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 299/597] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:48 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:48.779252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:48.788626 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-06a08eee-a3a5-410b-b995-a1453ba37591 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.199347 Aug 24 03:40:48.789337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 299/598] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:48 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:49.692123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:49.692729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:49.700253 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.700691 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.701125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.701805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.702325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.702750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.822516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:49.822516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:49.822516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:49.822516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.822516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.823863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.823863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:49.824154 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:49.824395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:49.854522 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.874288 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4fa1c9eb-96be-4f6a-b628-7924e514fa0f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.185395 Aug 24 03:40:49.875493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 300/599] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:49 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:49.971001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:49.978989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a0e83411-11b1-4d20-9f8b-c0dd736578ce tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1358 microversion: 2.1 time: 0.170018 Aug 24 03:40:49.979567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 300/600] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:49 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:50.896507 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:50.897767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:50.904580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.905247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.905881 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:50.906832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:50.908187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:50.908772 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.002677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:51.003398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:51.009556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.010170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.010698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.011819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.012396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.012903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.077489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.087212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4bbbf90f-8fbc-4b59-ab32-a09b2d6b0aff tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.196211 Aug 24 03:40:51.087729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 301/601] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:50 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:51.177854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.185893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f6eafc6a-6cbf-44cd-968b-8ed63d51e56d tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1548 microversion: 2.1 time: 0.188460 Aug 24 03:40:51.186533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 301/602] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:50 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:51.207844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:51.208782 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:51.216260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.216987 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.217476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.218109 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.220273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.220710 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.374067 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.382426 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1854ade5-5337-4853-9c1b-e33f4d9ba259 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1548 microversion: 2.1 time: 0.179185 Aug 24 03:40:51.382961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 302/603] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:51 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:51.403205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:51.408613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.409390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Searching by: {'deleted': False, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b'} {{(pid=127260) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:40:51.416109 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.416599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.417031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.417760 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.418273 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.418697 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.518991 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.multi_cell_list [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127260) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:40:51.629701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e9c6ce9b-36a8-4a35-8645-5f0144a7cec8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.230853 Aug 24 03:40:51.630472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 302/604] 10.222.0.91 () {58 vars in 1125 bytes} [Wed Aug 24 03:40:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:51.643425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:51.644042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:51.650935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.651571 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.652323 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.653492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:51.655630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:51.656103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:51.814366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:51.822974 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a94b364f-7dd3-496f-bcfc-d04f60d7aef8 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1548 microversion: 2.1 time: 0.184928 Aug 24 03:40:51.823580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 303/605] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:51 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:52.108838 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:52.109497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:52.119149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:52.121859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:52.122942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:52.123938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:52.124630 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:52.125544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:52.409733 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:52.418489 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6a1f637f-cdb0-401d-9908-acaa3e141be6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.313363 Aug 24 03:40:52.419073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 303/606] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:52 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:53.444239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:53.446327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:53.456226 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:53.456785 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:53.457286 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:53.458062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:53.458815 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:53.459479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:53.618055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:53.626366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9c782f0a-00af-41fc-95e8-81109c9a57b2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.189022 Aug 24 03:40:53.626927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 304/607] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:53 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:54.538462 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aedc236-9eee-4158-bccd-bcdaa2f4dae4"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:54.540879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:54.550213 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.552431 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.553071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.553984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.554646 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.555251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.649273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:54.650006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:54.661090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.661585 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.663689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.667377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.667868 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.669822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.677856 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:54.877493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:54.885828 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ee0e0db1-eef0-497f-af3f-57a8374d21bf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.240543 Aug 24 03:40:54.902217 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 305/608] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:54 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:54.908238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-53e8c646-2ffd-4d6e-b466-a2fa5716e56a req-868149f8-c058-4d89-b090-3c00515fd8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6560bb95-66b1-4d4f-a87b-4bc63cd92674", "name": "network-vif-plugged", "status": "completed", "tag": "38238e64-0e40-4fe3-b325-5d4013cfe9ab"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:54.919538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-53e8c646-2ffd-4d6e-b466-a2fa5716e56a req-868149f8-c058-4d89-b090-3c00515fd8b8 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:54.920293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-53e8c646-2ffd-4d6e-b466-a2fa5716e56a req-868149f8-c058-4d89-b090-3c00515fd8b8 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:54.920865 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-53e8c646-2ffd-4d6e-b466-a2fa5716e56a req-868149f8-c058-4d89-b090-3c00515fd8b8 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:54.933850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-53e8c646-2ffd-4d6e-b466-a2fa5716e56a req-868149f8-c058-4d89-b090-3c00515fd8b8 service nova] Creating event network-vif-plugged:38238e64-0e40-4fe3-b325-5d4013cfe9ab for instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 on hv-cinder-85426 Aug 24 03:40:54.940690 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-53e8c646-2ffd-4d6e-b466-a2fa5716e56a req-868149f8-c058-4d89-b090-3c00515fd8b8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036535 Aug 24 03:40:54.942256 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 306/609] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:54.986820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d177d876-c63c-49f6-a1b3-c50bc1d90980 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "POST /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451499 Aug 24 03:40:54.987543 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 304/610] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:40:54 2022] POST /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:55.915912 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:55.916995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:55.924786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:55.925280 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:55.925720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:55.926714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:55.927169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:55.927630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.082545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:56.092488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5cc51c45-3eac-4968-a08e-aa7989cb9e2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.184040 Aug 24 03:40:56.096075 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 307/611] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:55 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:57.118728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:57.119433 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:57.125755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.126309 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.126748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.127501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.127952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.128374 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.283020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:57.291593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-512cea43-fed4-42bd-8edb-1fd2081008bb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1370 microversion: 2.1 time: 0.178291 Aug 24 03:40:57.292271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 305/612] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:57 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:58.316273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:58.316914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:58.323554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.324036 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.324477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.325180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.325633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.326059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.484945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.494123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a47c9294-4358-4922-af23-ecb7231c6fb1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1565 microversion: 2.1 time: 0.182250 Aug 24 03:40:58.494734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 308/613] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:58 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:58.517273 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:58.517877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:58.524427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.524903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.525338 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.526037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:58.526545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:58.526987 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.627345 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7bde6eee-4e69-429e-9e44-1989549604d2 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115005 Aug 24 03:40:58.628029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 306/614] 10.222.0.91 () {58 vars in 1275 bytes} [Wed Aug 24 03:40:58 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:59.978697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-b6ca20f9-8b1a-4221-b304-4154e1c00057 req-50144228-4cb3-40f8-9f13-cdfcbeeac732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6560bb95-66b1-4d4f-a87b-4bc63cd92674", "tag": "38238e64-0e40-4fe3-b325-5d4013cfe9ab"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:59.994432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b6ca20f9-8b1a-4221-b304-4154e1c00057 req-50144228-4cb3-40f8-9f13-cdfcbeeac732 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:59.995010 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b6ca20f9-8b1a-4221-b304-4154e1c00057 req-50144228-4cb3-40f8-9f13-cdfcbeeac732 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:59.995788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b6ca20f9-8b1a-4221-b304-4154e1c00057 req-50144228-4cb3-40f8-9f13-cdfcbeeac732 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.010480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-b6ca20f9-8b1a-4221-b304-4154e1c00057 req-50144228-4cb3-40f8-9f13-cdfcbeeac732 service nova] Creating event network-changed:38238e64-0e40-4fe3-b325-5d4013cfe9ab for instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 on hv-cinder-85426 Aug 24 03:41:00.016362 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-b6ca20f9-8b1a-4221-b304-4154e1c00057 req-50144228-4cb3-40f8-9f13-cdfcbeeac732 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041770 Aug 24 03:41:00.017491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 309/615] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:04.819838 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:04.824349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:04.824967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:04.831560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:04.832065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:04.832503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:04.833295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:04.833752 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:04.834177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:04.976266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:04.986034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d6186181-f93b-42b2-b83d-803c15859283 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1594 microversion: 2.1 time: 0.166854 Aug 24 03:41:04.986657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 307/616] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:04 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:06.881350 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-ad886ccf-dbdd-4dd1-ad76-f22e558f81f0 req-af92695f-ae8c-4fcf-bdf5-faef6a52e290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719d0058-3b46-49ca-88e3-96546c996278", "tag": "09ae71df-f7d0-490a-a020-01bb30ef1264"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:06.894142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-ad886ccf-dbdd-4dd1-ad76-f22e558f81f0 req-af92695f-ae8c-4fcf-bdf5-faef6a52e290 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.895259 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-ad886ccf-dbdd-4dd1-ad76-f22e558f81f0 req-af92695f-ae8c-4fcf-bdf5-faef6a52e290 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.896004 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-ad886ccf-dbdd-4dd1-ad76-f22e558f81f0 req-af92695f-ae8c-4fcf-bdf5-faef6a52e290 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.913005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-ad886ccf-dbdd-4dd1-ad76-f22e558f81f0 req-af92695f-ae8c-4fcf-bdf5-faef6a52e290 service nova] Creating event network-changed:09ae71df-f7d0-490a-a020-01bb30ef1264 for instance 719d0058-3b46-49ca-88e3-96546c996278 on hv-cinder-85426 Aug 24 03:41:06.918291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-ad886ccf-dbdd-4dd1-ad76-f22e558f81f0 req-af92695f-ae8c-4fcf-bdf5-faef6a52e290 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043468 Aug 24 03:41:06.919071 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 310/617] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:07.864715 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-104341195"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:07.865893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:07.872732 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.873285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.873727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.874472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.875021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.875447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.013036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.network.security_group_api [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Adding security group b8f2f514-2672-45f5-b000-6c34ee3a833d to port 09ae71df-f7d0-490a-a020-01bb30ef1264 Aug 24 03:41:08.346288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-dc6be4b5-dcc0-44be-b1b7-df004c46bcc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "POST /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/action" status: 202 len: 0 microversion: 2.1 time: 0.486238 Aug 24 03:41:08.346985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 308/618] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:41:07 2022] POST /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:08.356412 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:08.357252 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:08.364014 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.364495 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.364941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.365630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.366098 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.367192 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.519120 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:08.527353 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4b820a26-d47b-474c-bb57-c4a25904fbb0 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1640 microversion: 2.1 time: 0.175526 Aug 24 03:41:08.527848 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 311/619] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:08 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1640 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:08.934215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-f3c10869-3df5-4ff4-8c5e-f4bd61086bd5 req-af11c27b-b491-490f-98a0-d6a65e4a62a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719d0058-3b46-49ca-88e3-96546c996278", "tag": "09ae71df-f7d0-490a-a020-01bb30ef1264"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:08.944795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-f3c10869-3df5-4ff4-8c5e-f4bd61086bd5 req-af11c27b-b491-490f-98a0-d6a65e4a62a0 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.945271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-f3c10869-3df5-4ff4-8c5e-f4bd61086bd5 req-af11c27b-b491-490f-98a0-d6a65e4a62a0 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.945708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-f3c10869-3df5-4ff4-8c5e-f4bd61086bd5 req-af11c27b-b491-490f-98a0-d6a65e4a62a0 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.958136 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-f3c10869-3df5-4ff4-8c5e-f4bd61086bd5 req-af11c27b-b491-490f-98a0-d6a65e4a62a0 service nova] Creating event network-changed:09ae71df-f7d0-490a-a020-01bb30ef1264 for instance 719d0058-3b46-49ca-88e3-96546c996278 on hv-cinder-85426 Aug 24 03:41:08.963394 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-f3c10869-3df5-4ff4-8c5e-f4bd61086bd5 req-af11c27b-b491-490f-98a0-d6a65e4a62a0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033206 Aug 24 03:41:08.963994 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 309/620] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:17.230465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:17.230986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:17.233222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=30 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:17.239220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.239705 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.240137 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.240833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:17.241282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:17.241706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:17.265794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c0d165ad-02d0-4e2d-b40e-fc9b35022708 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/ips" status: 200 len: 151 microversion: 2.20 time: 0.039171 Aug 24 03:41:17.266590 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 312/621] 10.222.0.91 () {60 vars in 1289 bytes} [Wed Aug 24 03:41:17 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:41:21.428177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=19 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:21.429061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:21.433724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:21.434388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:21.442694 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:21.443172 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:21.443606 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:21.444288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:21.444741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:21.445165 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:21.470660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.objects.instance [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lazy-loading 'flavor' on Instance uuid e834164b-a670-4f2a-8322-0d968d8e6703 {{(pid=127260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:21.648168 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-18291766-a4c7-4d5a-866e-89d106327e70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/action" status: 202 len: 0 microversion: 2.20 time: 0.221860 Aug 24 03:41:21.648759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 310/622] 10.222.0.91 () {62 vars in 1319 bytes} [Wed Aug 24 03:41:21 2022] POST /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:41:21.657168 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:21.657779 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:21.664879 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:21.665327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:21.665772 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:21.666512 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:21.666976 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:21.667408 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:21.795739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:21.804705 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:21.806177 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:21.807344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9c11261e-354a-41ec-be6a-5174b1b20ab9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.154066 Aug 24 03:41:21.807898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 313/623] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:21 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:22.831613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:22.832223 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:22.839161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:22.839645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:22.840084 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:22.840790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:22.841240 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:22.841661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:22.982670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:22.991595 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:22.993090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:22.994267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4af832f5-fbbc-4eb3-bffb-794e0a28b0b1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.167387 Aug 24 03:41:22.994823 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 311/624] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:22 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:24.018594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:24.019182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:24.025535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:24.026011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:24.026476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:24.027151 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:24.027595 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:24.028011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:24.161124 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:24.170433 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:24.171953 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:24.173656 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f66ba012-ac9e-4ba0-96ba-2c5b27107165 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.159564 Aug 24 03:41:24.174252 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 314/625] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:24 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:25.197380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:25.197976 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:25.204553 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.205073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.205508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.206233 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:25.206666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:25.207091 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:25.345764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:25.354526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:25.356035 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:25.357186 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b77d0964-d500-4c1f-a417-07dae67d4715 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.163879 Aug 24 03:41:25.357740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 312/626] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:25 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:26.380114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:26.380680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:26.387180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:26.387666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:26.388104 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:26.388802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:26.389261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:26.389691 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:26.392945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=45 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:26.521581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:26.529753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:26.531278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:26.533144 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4204189b-82e6-4b8a-ad8b-d16d3c29a89b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.156347 Aug 24 03:41:26.533701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 315/627] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:26 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:27.568226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:27.568736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:27.575462 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:27.575953 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:27.576390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:27.577091 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:27.577547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:27.577973 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:27.715727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:27.733074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:27.736174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:27.737776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4fb0bf09-666b-4010-8311-54bb5687e6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.184833 Aug 24 03:41:27.745656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 313/628] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:27 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:28.767033 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:28.768142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:28.781867 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:28.783374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:28.784195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:28.785394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:28.786208 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:28.786951 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:28.950462 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:28.959860 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:28.961384 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:28.962603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4b7f1c2b-745d-42a6-b27b-d3334fd1947d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.204727 Aug 24 03:41:28.963420 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 316/629] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:28 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:29.986009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:29.986799 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:30.001409 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:30.002751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:30.003834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:30.006593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:30.007100 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:30.007570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:30.369092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:30.378656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:30.380352 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:30.381763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bca4565c-8f12-4709-8308-3bca40353670 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.399380 Aug 24 03:41:30.382330 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 314/630] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:29 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:31.405097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:31.405722 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:31.412198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:31.412707 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:31.413147 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:31.413842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:31.414326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:31.414755 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:31.607774 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:31.616311 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:31.617822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:31.619040 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a6de644a-7842-4024-8515-4ea5086aceb4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.217916 Aug 24 03:41:31.619602 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 317/631] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:31 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:32.640830 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:32.642149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:32.648784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.649271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.649942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.650796 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:32.651258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:32.651685 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:32.791685 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:32.799972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:32.801449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:32.802872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ff7ae712-72ca-47d0-ae92-52db7b538b65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.165955 Aug 24 03:41:32.803416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 315/632] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:32 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:33.826096 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:33.826736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:33.833841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:33.834347 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:33.834792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:33.835465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:33.835906 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:33.836333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:33.970959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:33.980781 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:33.982816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:33.984125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-96d3a93a-28f1-46db-b2dd-e58f4863994b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.161910 Aug 24 03:41:33.984677 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 318/633] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:33 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:35.007823 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:35.008418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:35.015032 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:35.015508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:35.015962 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:35.017344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:35.017794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:35.018246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:35.172342 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:35.181524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:35.183083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:35.184256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4ce765ae-0c02-4361-ba03-68e24cfd594d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.180477 Aug 24 03:41:35.184999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 316/634] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:35 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:36.210384 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:36.211098 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:36.218761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:36.219359 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:36.220040 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.220827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:36.221572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:36.222467 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:36.392368 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.402134 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.403866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:36.408978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0506921f-7670-4324-aafe-18af8cd62f9d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.200644 Aug 24 03:41:36.418535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 319/635] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:36 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:37.432604 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:37.433206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:37.444236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.444719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.445148 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.445842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:37.446320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:37.446736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:37.585363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.593513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.595071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:37.596256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8277cab1-125a-48de-9615-5db233b0999f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.167531 Aug 24 03:41:37.597000 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 317/636] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:37 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:38.620103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:38.620652 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:38.627667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.628148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.628584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.629278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:38.629731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:38.630154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:38.768553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:38.780623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:38.782552 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:38.784100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-133ff86b-106a-4473-ad8e-bed5973ad7c8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.168180 Aug 24 03:41:38.784829 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 320/637] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:38 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:39.806963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:39.807493 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:39.813836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:39.814346 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:39.814778 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:39.815490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:39.815933 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:39.816347 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:39.950432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:39.959158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:39.960651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:39.961805 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-787de28e-9bae-4354-9add-1ce4b4937294 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.158848 Aug 24 03:41:39.962390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 318/638] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:39 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:40.985387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:40.985976 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:40.993533 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.994104 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.994579 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:40.995277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:40.995729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:40.996182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:41.140142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.149405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.150992 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:41.152365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-edee289b-1f92-4b17-82df-43f7448b89c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.171225 Aug 24 03:41:41.154233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 321/639] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:40 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:42.182895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:42.183814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:42.190315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:42.190807 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:42.191237 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:42.191928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:42.192379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:42.192800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:42.349757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:42.358030 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:42.359541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:42.360788 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5969f41d-ecdd-442d-b860-b00226b7a693 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.181713 Aug 24 03:41:42.361407 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 319/640] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:42 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:43.384207 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.384747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:43.390968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.391521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.391954 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.392649 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.393118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.393544 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.686048 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.694989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.696535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:43.697765 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a9c04cc7-c777-45db-86f1-02bbe1a5532f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.317573 Aug 24 03:41:43.698375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 322/641] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:43 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:43.929697 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.930272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:43.937066 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.937464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.937906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.939218 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:43.939678 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:43.940103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:43.965829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-576e3f23-2103-4ae5-91e0-d184f15ca99a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/ips" status: 200 len: 150 microversion: 2.1 time: 0.041117 Aug 24 03:41:43.966447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 320/642] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:41:43 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:44.720380 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:44.720968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:44.728172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.728799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.729296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.730346 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.730864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.731422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.922686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.931659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.933135 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:44.934569 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4723b743-5d73-4c99-9529-a31449b5f06b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.218027 Aug 24 03:41:44.935117 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 323/643] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:44 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:45.957843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:45.958474 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:45.964976 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:45.965474 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:45.965958 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:45.966769 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:45.967224 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:45.967584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.155357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.167731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.169400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:46.170585 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7965168e-ce22-47c2-b2fb-94e8ec007f70 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.216682 Aug 24 03:41:46.171144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 321/644] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:45 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:46.439927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0d149dd-e9e7-43ec-a3ee-633e78920404"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:46.442373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:46.448845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:46.449354 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:46.449801 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.450555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:46.450998 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:46.451435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.773517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8e5105e8-0995-4fef-bd9c-5ad4f6d8fe90 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337343 Aug 24 03:41:46.774279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 324/645] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:41:46 2022] POST /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:47.193663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:47.194220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:47.201014 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:47.201494 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:47.201926 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:47.202651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:47.203108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:47.203529 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:47.357583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:47.370388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:47.372809 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:47.374669 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-27acd964-65e0-4d86-8ef3-de9f03a9f08f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.184681 Aug 24 03:41:47.375583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 322/646] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:47 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:48.404551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:48.405243 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:48.407785 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=26 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:48.414204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:48.414713 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:48.415166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:48.416099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:48.416645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:48.417156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:48.608361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:48.620481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:48.622448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:48.623893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6d5e14f5-9703-4bdd-92eb-b89f672cdec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.224357 Aug 24 03:41:48.625715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 325/647] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:48 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:49.647345 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:49.647943 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:49.654752 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.655271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.655740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.656472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:49.656962 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:49.657426 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:49.810076 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.819018 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.820525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:49.821684 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d7e7d3f7-33cc-435c-80a7-7b6b476207ee tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.178418 Aug 24 03:41:49.822256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 323/648] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:49 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:50.845176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:50.846051 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:50.852824 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:50.853322 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:50.853740 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:50.854451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:50.854904 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:50.855326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:50.999323 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:51.008511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:51.010016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:51.011203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e4b84c21-c275-4813-9184-1cd1796ceded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.170672 Aug 24 03:41:51.011761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 326/649] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:50 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:52.035706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:52.036306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:52.038995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=29 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:52.045230 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.045750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.046207 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.046906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:52.047379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:52.048468 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:52.051430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:52.188925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.198578 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.200118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:52.201279 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4e96684b-bfa4-4070-976c-4c5c83a13812 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1745 microversion: 2.20 time: 0.169850 Aug 24 03:41:52.201910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 324/650] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:52 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:53.224842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:53.225449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:53.231945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.232423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.233219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.234016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:53.234666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:53.235194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:53.368396 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.376682 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.378225 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:53.379398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-32829a18-4a65-41d6-b7c1-27a85f5db8ca tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1745 microversion: 2.20 time: 0.158499 Aug 24 03:41:53.380170 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 327/651] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:53 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:54.035980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:41:54.036194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 03:41:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:41:54.412854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:54.414284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:54.421504 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.422012 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.422534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.423235 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.423687 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.424110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.576193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:54.577681 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c7630647-3251-4bba-ac55-56e9111dcf61 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: .version_select at 0x7f077c1cef70>, body: {"keypair": {"name": "tempest-keypair-894544252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOq3DvL7kkAykufKfJ5VR/NGJnHXOiuPsTP5oHLGdrezLaIMI83bq+0lj9Dz9tubLBJTAW6A8eCWgHvAVULbQsHIl1Xg2+MQao1JYoVzaTwiEARcN5ov/WRHQ5WdVg9VQ=="}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:54.585795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:54.588198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:54.589430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-198a509c-42c7-4781-9045-f788af6f596d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1745 microversion: 2.20 time: 0.190223 Aug 24 03:41:54.590304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 325/652] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:54 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:54.596949 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-c7630647-3251-4bba-ac55-56e9111dcf61 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for project c7c94d613f6b440bae60fc442661c671. Resources: {'key_pairs'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:54.601319 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-c7630647-3251-4bba-ac55-56e9111dcf61 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for user b1d9d5fd0db54ddf85e05c77dd7f6c89 and project c7c94d613f6b440bae60fc442661c671. Resources: {'key_pairs'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:54.629734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c7630647-3251-4bba-ac55-56e9111dcf61 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055952 Aug 24 03:41:54.630587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 328/653] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:41:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:41:55.492535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-f6b49807-80da-49eb-8f13-16ea3c2d7446 req-d16e7ce3-c8ac-48a9-9750-fdbc8ac0e0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e834164b-a670-4f2a-8322-0d968d8e6703", "name": "network-vif-plugged", "status": "completed", "tag": "0f8767fa-c35d-4362-bf07-a72ca2d4c311"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:55.505263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-f6b49807-80da-49eb-8f13-16ea3c2d7446 req-d16e7ce3-c8ac-48a9-9750-fdbc8ac0e0c1 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.505736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-f6b49807-80da-49eb-8f13-16ea3c2d7446 req-d16e7ce3-c8ac-48a9-9750-fdbc8ac0e0c1 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.506166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-f6b49807-80da-49eb-8f13-16ea3c2d7446 req-d16e7ce3-c8ac-48a9-9750-fdbc8ac0e0c1 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.519917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-f6b49807-80da-49eb-8f13-16ea3c2d7446 req-d16e7ce3-c8ac-48a9-9750-fdbc8ac0e0c1 service nova] Creating event network-vif-plugged:0f8767fa-c35d-4362-bf07-a72ca2d4c311 for instance e834164b-a670-4f2a-8322-0d968d8e6703 on hv-cinder-85426 Aug 24 03:41:55.525735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-f6b49807-80da-49eb-8f13-16ea3c2d7446 req-d16e7ce3-c8ac-48a9-9750-fdbc8ac0e0c1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037726 Aug 24 03:41:55.526653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 326/654] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:55.614078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:55.614725 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:55.621272 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.621736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.622197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.622910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.623357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.623787 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.832429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.843873 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.846160 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.847454 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f41fc3f7-ded7-4edb-9a58-603a0276abb9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1745 microversion: 2.20 time: 0.239044 Aug 24 03:41:55.848011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 329/655] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:55 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:56.046590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1485483195", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "179f4006-1dcb-402a-823f-dec3eb79c3e6"}], "security_groups": [{"name": "tempest-securitygroup--13477370"}], "key_name": "tempest-keypair-894544252", "user_data": "}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:56.150772 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] validate_networks() for [('179f4006-1dcb-402a-823f-dec3eb79c3e6', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:41:56.636252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:41:56.636827 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:41:56.637134 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:41:56.637541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:41:56.637950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:41:56.647004 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.647485 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.647921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.648641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.649095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.649516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.666327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for project c7c94d613f6b440bae60fc442661c671. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:56.671982 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for user b1d9d5fd0db54ddf85e05c77dd7f6c89 and project c7c94d613f6b440bae60fc442661c671. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:56.686237 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:41:56.689122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:41:56.735792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d0c207f4-6395-44e9-a499-9c2653770712 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.693846 Aug 24 03:41:56.736427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 327/656] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:41:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:41:56.747004 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0808d78a-e712-4906-a857-22a0687c4683 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:56.747613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0808d78a-e712-4906-a857-22a0687c4683 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:56.804228 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0808d78a-e712-4906-a857-22a0687c4683 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:56.811594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0808d78a-e712-4906-a857-22a0687c4683 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1241 microversion: 2.1 time: 0.068302 Aug 24 03:41:56.812166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 330/657] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:56 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:56.870567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:56.871211 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:56.878793 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.879288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.879727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.880432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.880896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.881376 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.021753 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.030233 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.031751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.033429 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-069ba05e-6220-4d95-8849-81f2f186a302 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1745 microversion: 2.20 time: 0.166713 Aug 24 03:41:57.033988 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 328/658] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:56 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:57.833633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:57.834379 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:57.842012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.842509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.842938 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.843618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:57.844066 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:57.845100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.847837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:57.911438 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.919372 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8fec3310-2251-43f6-86bc-448fa1fc0900 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1293 microversion: 2.1 time: 0.089562 Aug 24 03:41:57.919949 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 331/659] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:57 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:58.058514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:58.059355 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:58.066289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.066781 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.067421 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.068162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.068602 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.069196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.279282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.288319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.289813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.291110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6e17b7fa-6d4e-4b76-8719-d7db93834f9f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1745 microversion: 2.20 time: 0.236945 Aug 24 03:41:58.291719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 329/660] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:58 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1745 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:58.941970 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:58.942693 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:58.950502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.951090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.951861 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.953107 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.954844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.956103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.113763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.123308 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-40a2c3dd-be9c-45f0-90d8-9691567b6c26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.186359 Aug 24 03:41:59.137145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 332/661] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:58 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:59.315135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:59.315765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:59.323196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.323682 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.324151 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.324894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.325353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.325778 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.528131 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.537329 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.538877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:59.540117 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7458c374-74a8-421f-ac91-72402f97aaf8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1745 microversion: 2.20 time: 0.229011 Aug 24 03:41:59.540686 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 330/662] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:41:59 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1745 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:59.777383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-91bcbd79-37fe-4ca9-8212-3a8dbf252960 req-cb8f08b0-f40b-4f68-b119-9412e2302453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c09002f-a0ab-4747-8932-0b86085e8785", "tag": "d9fd34e0-e020-4b53-9a95-9ee189ca2343"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:59.787731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-91bcbd79-37fe-4ca9-8212-3a8dbf252960 req-cb8f08b0-f40b-4f68-b119-9412e2302453 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.788212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-91bcbd79-37fe-4ca9-8212-3a8dbf252960 req-cb8f08b0-f40b-4f68-b119-9412e2302453 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.788658 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-91bcbd79-37fe-4ca9-8212-3a8dbf252960 req-cb8f08b0-f40b-4f68-b119-9412e2302453 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.806146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-91bcbd79-37fe-4ca9-8212-3a8dbf252960 req-cb8f08b0-f40b-4f68-b119-9412e2302453 service nova] Creating event network-changed:d9fd34e0-e020-4b53-9a95-9ee189ca2343 for instance 2c09002f-a0ab-4747-8932-0b86085e8785 on hv-cinder-85426 Aug 24 03:41:59.814538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-91bcbd79-37fe-4ca9-8212-3a8dbf252960 req-cb8f08b0-f40b-4f68-b119-9412e2302453 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041267 Aug 24 03:41:59.819483 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 333/663] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:00.150275 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:00.151088 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:00.158717 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.159321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.159915 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.160708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.161155 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.161733 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.364598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.373356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0375bae5-07e0-4296-9002-5ee05f1d33b3 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.227955 Aug 24 03:42:00.373937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 331/664] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:00 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:00.576507 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:00.577540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:00.591181 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.592555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.594178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.596237 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:00.597262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:00.598274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:00.859634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.874743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.877531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:00.878931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f54bf7a7-9a46-4edd-8159-2be7b5e81fdf tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.311101 Aug 24 03:42:00.894212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 334/665] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:00 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:01.408108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:01.409346 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:01.422151 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.423695 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.424413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.426237 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.427572 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.428672 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.622802 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:01.636324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-113632ee-57b8-481a-9cfb-50b829174e4f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.235411 Aug 24 03:42:01.640166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 332/666] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:01 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:01.903423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:01.905120 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:01.913147 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.914009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.914627 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.915903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.916864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.917791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.131565 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.144719 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.147766 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.149789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-aa884afb-0a52-4567-a666-850fe126020f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.250128 Aug 24 03:42:02.159239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 335/667] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:01 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:02.658787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.660249 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.667063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.667537 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.667972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.668662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.669116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.669527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.872388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:02.885413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-686f8ca8-59a9-41d1-92fc-2e3f8155e756 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.231400 Aug 24 03:42:02.887486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 333/668] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:02 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:03.176323 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:03.177808 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:03.185905 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.186649 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.187842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.189726 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.190382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.190811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.388585 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.397533 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.399227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:03.400433 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-475240a7-5794-4f05-bc85-4d1bbaeb29c3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.229385 Aug 24 03:42:03.401002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 336/669] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:03 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:03.911774 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:03.913055 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:03.926737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.927754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.928819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.930000 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.930721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.931459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.167431 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.183165 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cc38adc2-eda9-4264-b8e2-26382101cf65 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.276354 Aug 24 03:42:04.184483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 334/670] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:03 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:04.424583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:04.425847 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:04.439058 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.439813 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.440885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.442521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:04.443578 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:04.444539 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:04.614037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.622236 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.623743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:04.624896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6bb09c84-0850-4c09-b577-e5c06ddc6f22 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.204615 Aug 24 03:42:04.625453 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 337/671] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:04 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:05.207401 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:05.208012 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:05.214568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.215330 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.217331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.218175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.219269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.219269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.450763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.464890 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e46f84d0-3177-4278-ac28-a310762d6b5b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.261611 Aug 24 03:42:05.466935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 335/672] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:05 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:05.665175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:05.667343 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:05.685498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.686779 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.687854 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.690314 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:05.691503 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:05.692558 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:05.914918 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.926536 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.928730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:05.930576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-08fa5551-9ebc-4956-ae66-c2694219c3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.275931 Aug 24 03:42:05.931985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 338/673] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:05 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:06.490767 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:06.491792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:06.499856 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.500568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.501536 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.502317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.502937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.503585 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.658787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:06.681686 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:06.684267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=6 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:06.692760 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-abce3933-75cc-4383-b53d-4168686ff765 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.207428 Aug 24 03:42:06.693438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 336/674] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:06 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:06.967867 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:06.968743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:06.979505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:06.995785 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.996571 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:06.997508 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:06.998873 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:06.999848 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.000669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.184482 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.196198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.197966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.199230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b8853ed2-ad82-4850-81f6-4c3ecdb3df5d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.240322 Aug 24 03:42:07.200009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 339/675] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:06 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:07.718659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:07.720591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:07.727169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.728037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.728721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.729642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:07.730341 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:07.731114 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:07.934762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:07.946169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-848e6a4f-8b7f-408b-8132-c1bd3ce5fecb tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.233434 Aug 24 03:42:07.947692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 337/676] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:07 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:08.133871 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-75bd51dd-f0f6-4a79-a78c-dbc98e6b650e req-00dcfb3c-ff68-48c3-9140-b3399436e15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c09002f-a0ab-4747-8932-0b86085e8785", "name": "network-vif-plugged", "status": "completed", "tag": "d9fd34e0-e020-4b53-9a95-9ee189ca2343"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:08.147553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-75bd51dd-f0f6-4a79-a78c-dbc98e6b650e req-00dcfb3c-ff68-48c3-9140-b3399436e15d service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.148031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-75bd51dd-f0f6-4a79-a78c-dbc98e6b650e req-00dcfb3c-ff68-48c3-9140-b3399436e15d service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.148462 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-75bd51dd-f0f6-4a79-a78c-dbc98e6b650e req-00dcfb3c-ff68-48c3-9140-b3399436e15d service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.168243 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-75bd51dd-f0f6-4a79-a78c-dbc98e6b650e req-00dcfb3c-ff68-48c3-9140-b3399436e15d service nova] Creating event network-vif-plugged:d9fd34e0-e020-4b53-9a95-9ee189ca2343 for instance 2c09002f-a0ab-4747-8932-0b86085e8785 on hv-cinder-85426 Aug 24 03:42:08.175771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-75bd51dd-f0f6-4a79-a78c-dbc98e6b650e req-00dcfb3c-ff68-48c3-9140-b3399436e15d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045383 Aug 24 03:42:08.176667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 340/677] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:08.224475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:08.242161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:08.249928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.250437 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.254780 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.255942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.256455 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.256921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.455304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:08.470608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:08.472651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:08.474418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-eddd3039-b991-4af2-9029-6ddd2fa5247b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.255592 Aug 24 03:42:08.475498 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 338/678] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:08 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:08.971327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:08.972034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:08.979620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.980497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.981159 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:08.982085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:08.982951 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:08.983622 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:09.171730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.185139 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1f1ad72c-9bda-4075-a74a-acda12902cef tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.218710 Aug 24 03:42:09.186646 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 341/679] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:08 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:09.511503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:09.512194 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:09.519638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:09.520149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:09.520655 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:09.521358 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:09.521809 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:09.522250 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:09.699133 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.712379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.713978 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:09.715195 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-23f24d3e-bfb1-4982-8eec-6894ed735d96 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.207663 Aug 24 03:42:09.715759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 339/680] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:09 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:10.213831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:10.214624 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:10.221743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.222349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.222795 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.223623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.223963 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.224466 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.392733 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.401407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-77a2cd56-db18-49fe-a733-df483b8985c6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1365 microversion: 2.1 time: 0.191692 Aug 24 03:42:10.402070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 342/681] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:10 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:10.742254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:10.742880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:10.749431 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.749942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.750391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.751152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:10.751555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:10.751983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:10.887392 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.895600 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.897081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:10.898241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0b2e6e37-67a4-4b4d-997c-49facda4b0e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1740 microversion: 2.20 time: 0.160014 Aug 24 03:42:10.898829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 340/682] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:10 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:11.421887 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:11.423066 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:11.429840 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.430379 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.430818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.431514 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.431968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.432390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.562838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:11.570448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e4feb695-4bd5-4f5d-a2f2-d78344573146 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1554 microversion: 2.1 time: 0.152403 Aug 24 03:42:11.571008 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 343/683] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:11 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:11.591900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:11.592393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:11.599033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.599513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.599975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.600659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.601109 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.601529 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.678168 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4364f17e-aa18-4373-81cc-f7d7d8a90344 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090019 Aug 24 03:42:11.679042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 341/684] 10.222.0.91 () {58 vars in 1275 bytes} [Wed Aug 24 03:42:11 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:11.921366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:11.921980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:11.929413 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.929809 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.930279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:11.930987 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:11.931440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:11.931866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:12.081703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:12.096072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:12.099113 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:12.101302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d391bd77-1573-4a6b-9951-a37709a76359 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1722 microversion: 2.20 time: 0.183670 Aug 24 03:42:12.102601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 344/685] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:11 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:13.125347 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:13.126263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:13.132398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.132876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.133308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.133995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.134475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.134895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.150348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:13.361179 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.361381 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-d4eec8fe-0050-47af-8ed9-5a6f75f35244 req-bd9c604e-eebe-495d-a33c-402a0a290f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c09002f-a0ab-4747-8932-0b86085e8785", "tag": "d9fd34e0-e020-4b53-9a95-9ee189ca2343"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:13.370685 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.371663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-d4eec8fe-0050-47af-8ed9-5a6f75f35244 req-bd9c604e-eebe-495d-a33c-402a0a290f52 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:13.372843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-d4eec8fe-0050-47af-8ed9-5a6f75f35244 req-bd9c604e-eebe-495d-a33c-402a0a290f52 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:13.373003 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:13.373133 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-d4eec8fe-0050-47af-8ed9-5a6f75f35244 req-bd9c604e-eebe-495d-a33c-402a0a290f52 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:13.373698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-34fee34c-041c-412a-b3f5-b030f41c6f41 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1722 microversion: 2.20 time: 0.252607 Aug 24 03:42:13.374353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 342/686] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:13 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:13.385198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-d4eec8fe-0050-47af-8ed9-5a6f75f35244 req-bd9c604e-eebe-495d-a33c-402a0a290f52 service nova] Creating event network-changed:d9fd34e0-e020-4b53-9a95-9ee189ca2343 for instance 2c09002f-a0ab-4747-8932-0b86085e8785 on hv-cinder-85426 Aug 24 03:42:13.390925 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-d4eec8fe-0050-47af-8ed9-5a6f75f35244 req-bd9c604e-eebe-495d-a33c-402a0a290f52 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034663 Aug 24 03:42:13.391649 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 345/687] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:14.199986 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-c837e1bc-f969-42b9-8ca8-65140c5981e1 req-fe073486-70d2-4670-934a-6b46d9d3536f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e834164b-a670-4f2a-8322-0d968d8e6703", "name": "network-vif-unplugged", "status": "completed", "tag": "0f8767fa-c35d-4362-bf07-a72ca2d4c311"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:14.210809 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c837e1bc-f969-42b9-8ca8-65140c5981e1 req-fe073486-70d2-4670-934a-6b46d9d3536f service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.211449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c837e1bc-f969-42b9-8ca8-65140c5981e1 req-fe073486-70d2-4670-934a-6b46d9d3536f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.211845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c837e1bc-f969-42b9-8ca8-65140c5981e1 req-fe073486-70d2-4670-934a-6b46d9d3536f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.224822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-c837e1bc-f969-42b9-8ca8-65140c5981e1 req-fe073486-70d2-4670-934a-6b46d9d3536f service nova] Creating event network-vif-unplugged:0f8767fa-c35d-4362-bf07-a72ca2d4c311 for instance e834164b-a670-4f2a-8322-0d968d8e6703 on hv-cinder-85426 Aug 24 03:42:14.230646 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-c837e1bc-f969-42b9-8ca8-65140c5981e1 req-fe073486-70d2-4670-934a-6b46d9d3536f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034086 Aug 24 03:42:14.231999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 343/688] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:14.397034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:14.397787 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:14.404772 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.405309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.405755 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.406486 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:14.406945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:14.407369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:14.548895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.557862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.559383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:14.560548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1365ac28-2013-4fa6-a7a5-29e368f3e7bc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1722 microversion: 2.20 time: 0.167793 Aug 24 03:42:14.561095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 346/689] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:14 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:15.584665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:15.585297 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.591420 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.591939 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.592418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.593155 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.593612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.594039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.768926 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:15.777285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:15.778984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:15.780241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-10b2ee9f-e040-4179-b442-c313de2304cc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1725 microversion: 2.20 time: 0.201190 Aug 24 03:42:15.780839 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 344/690] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:15 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:15.803122 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6311643b-d401-4134-a325-18a67c849c87"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:15.805768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:15.812321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.812802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.813331 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:15.813968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:15.814446 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:15.814868 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.020464 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:16.112008 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-daf79099-654c-4c3d-97df-073305d568a4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312881 Aug 24 03:42:16.112711 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 347/691] 10.222.0.91 () {62 vars in 1364 bytes} [Wed Aug 24 03:42:15 2022] POST /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:42:16.243765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:16.244360 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:16.250288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.251286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.251721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.252410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.252863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.253287 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.299448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127260) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:42:16.373206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-329c67a1-d9f2-4521-9ab8-d707d006fcda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/action" status: 202 len: 0 microversion: 2.20 time: 0.133263 Aug 24 03:42:16.373715 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 345/692] 10.222.0.91 () {62 vars in 1319 bytes} [Wed Aug 24 03:42:16 2022] POST /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:42:16.382352 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:16.382967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:16.389550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.390034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.390509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.391218 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:16.392239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:16.392667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:16.539062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.548655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.550312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:16.551460 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-18fdd591-7f10-452b-bd5c-20ba150bdddd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1751 microversion: 2.20 time: 0.173028 Aug 24 03:42:16.552012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 348/693] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:16 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:17.579923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:17.580516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:17.586836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:17.587331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:17.587764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.588466 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:17.589142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:17.589715 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:17.751288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.760196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.762284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:17.763361 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1e9850e2-dd45-44e2-9879-87f999efd4e3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1753 microversion: 2.20 time: 0.188595 Aug 24 03:42:17.764807 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 346/694] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:17 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:18.790249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:18.790863 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:18.793244 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:18.799075 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.799559 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.799996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.800681 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:18.801135 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:18.801557 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:18.935487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.943563 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.945273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:18.946275 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e6b9ce74-4b03-43d3-85dd-46a52b5b5815 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.160660 Aug 24 03:42:18.946837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 349/695] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:18 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:19.969135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:19.969710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:19.976778 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.977349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.977818 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:19.978373 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:19.978833 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:19.979254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:20.129379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.138636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.140129 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:20.141380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-05007780-72ca-4e31-9338-2f7a8794c30f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.176199 Aug 24 03:42:20.141949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 347/696] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:19 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:21.177341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:21.178296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:21.185363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.186161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.186644 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.187850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:21.189091 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:21.189572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:21.341188 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.354614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.356866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:21.358078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8687e634-0bdf-4c1d-9187-336bedbcf20c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.188153 Aug 24 03:42:21.358734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 350/697] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:21 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:22.386735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:22.388326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:22.392299 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:22.396638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.397156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.397598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.398759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:22.398894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:22.399221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:22.588232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.597370 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.599165 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:22.600224 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-71d85825-5a70-474c-8997-de97a773bb1a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.221173 Aug 24 03:42:22.600662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 348/698] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:22 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:23.629056 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:23.630154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:23.638104 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.638622 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.639059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.639786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:23.640240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:23.640665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:23.784476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.796636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.799206 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:23.801227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a939b2d1-cebb-45d1-ac3d-6de54e5e123d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.180118 Aug 24 03:42:23.802220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 351/699] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:23 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:24.825480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:24.826221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:24.833556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.834343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.834774 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:24.835467 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:24.835906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:24.836369 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:25.012511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.022713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.024211 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:25.025372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cb90f248-6570-4190-8135-6edec39a635d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.204356 Aug 24 03:42:25.026383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 349/700] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:24 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:26.054069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:26.055230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:26.062141 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.062534 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.062969 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.064220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:26.068140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:26.068636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:26.238970 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.249192 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.251342 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:26.252760 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f0e3fc36-8fcb-4316-a8a2-7d407b21c14b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.203579 Aug 24 03:42:26.253332 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 352/701] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:26 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:27.280033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:27.281013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:27.291323 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.291765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.292362 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.293380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:27.293843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:27.294311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:27.471512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.480916 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.482452 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:27.483639 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-55b38397-35a1-4051-8738-bd8775994613 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.210578 Aug 24 03:42:27.484568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 350/702] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:27 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:28.514426 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:28.515527 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:28.527593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.528453 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.529265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.530542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:28.531352 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:28.532609 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:28.711909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.725025 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.726937 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:28.728458 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b2a86e0d-a476-46aa-b667-9a2e2b7ae550 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.221008 Aug 24 03:42:28.729079 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 353/703] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:28 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:29.760484 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:29.763017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:29.771527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.772430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.773247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.775090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:29.775683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:29.776272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:29.947981 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.957492 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.959761 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:29.961193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-39bd2839-f5e3-47b5-99c5-ec31c0cb0863 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.206768 Aug 24 03:42:29.961778 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 351/704] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:29 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:30.987394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:30.988299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:30.995770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.996363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.997760 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:30.997760 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:30.997971 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:30.998319 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:31.180312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.191788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.193432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:31.194801 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5bb2afd0-b22b-4c6d-ae2d-1d26b56651c0 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.211575 Aug 24 03:42:31.195451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 354/705] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:30 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:32.219505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:32.220991 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:32.228319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.229198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.229866 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.230848 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:32.231530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:32.232180 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:32.419790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.431352 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.433063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:32.434278 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-87ca2ea2-9555-495f-84e9-1fbf8d87764f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.219182 Aug 24 03:42:32.434840 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 352/706] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:32 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:33.459645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:33.460271 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:33.466812 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.467290 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.467727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.468412 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:33.468861 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:33.469305 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:33.618743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.627982 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.629470 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:33.630749 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-18caca2e-1f9c-4c7f-9134-37767d9c7199 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.176639 Aug 24 03:42:33.631423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 355/707] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:33 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:34.655289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:34.655979 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:34.662385 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.662875 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.663311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:34.664006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:34.664459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:34.664979 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:34.803196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:34.812262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:34.814335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:34.815504 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-29aba91c-ea77-45f2-bfcc-daad6e60f986 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.164146 Aug 24 03:42:34.816067 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 353/708] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:34 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:35.838400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:35.839092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:35.846467 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:35.846948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:35.847382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:35.848078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:35.848520 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:35.848933 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:36.008485 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.018468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.020043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:36.021200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c2f25042-66ef-48be-8d5b-0388ca9acddc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.186838 Aug 24 03:42:36.021758 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 356/709] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:35 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:37.044713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:37.046752 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:37.054931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.055448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.055961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.056678 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:37.057135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:37.057559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:37.204919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.213634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.215141 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:37.216292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e12d237c-bf12-4206-9356-8c7e2f3d9acc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.175905 Aug 24 03:42:37.216849 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 354/710] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:37 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:38.242507 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:38.243146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:38.250128 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:38.250651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:38.251088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:38.251788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:38.252241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:38.252667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:38.383846 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.394153 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.395680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:38.396847 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a98e8abb-e79d-4a8a-ad78-1e9c32f0b6cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.158484 Aug 24 03:42:38.397401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 357/711] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:38 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:39.420643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:39.421254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:39.427867 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.428335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.428770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.429731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:39.430175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:39.430620 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:39.650074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.659318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.660725 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:39.661886 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-91b41792-4e52-4a95-9df6-03818d535065 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.245155 Aug 24 03:42:39.662472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 355/712] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:39 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:40.685473 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:40.686305 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:40.697669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.698542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.699315 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.700513 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:40.701322 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:40.702082 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:40.842844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.852778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.854366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:40.855518 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1d1bfa83-176a-4d66-964f-c8f4f4fadad4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.174149 Aug 24 03:42:40.856076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 358/713] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:40 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:41.881413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.882023 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:41.888573 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.889058 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.889497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:41.890202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:41.890659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:41.891116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:42.023409 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.032128 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.033644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:42.034839 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c9113b31-e6a3-413c-b737-d548cf6e9663 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.157316 Aug 24 03:42:42.035398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 356/714] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:43.057858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:43.058532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:43.065818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.066338 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.066777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.067477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:43.067934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:43.068363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:43.197070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.206171 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.207698 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:43.208842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-738a018b-b949-4ffa-96d8-5ac4de242b59 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.155152 Aug 24 03:42:43.209402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 359/715] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:43 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:44.231260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:44.231895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:44.239015 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.239495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.239923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.240605 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:44.241081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:44.241498 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:44.244119 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:44.376537 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.385226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.386756 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:44.387900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b56de14f-3e5a-4adf-8c43-f4685bbae6de tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.160607 Aug 24 03:42:44.388455 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 357/716] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:44 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:45.410877 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:45.411489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:45.417903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.418429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.418867 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.419554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:45.420011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:45.420435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:45.553114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.562965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.564988 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:45.566142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3bb02c9b-031f-4521-8178-1450e5614dfa tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.159906 Aug 24 03:42:45.566722 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 360/717] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:45 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:46.589314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:46.589898 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:46.596398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.596876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.597311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.598020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:46.598493 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:46.598918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:46.731163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:46.740264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:46.741763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:46.743020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-38a47586-6fb9-49dc-89f6-cdeabc6d1ded tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.157550 Aug 24 03:42:46.743590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 358/718] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:46 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:47.766349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:47.767572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:47.774629 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:47.775108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:47.775538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:47.776227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:47.776674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:47.777092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:47.779908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:47.927748 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.936771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.938576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:47.939745 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2179b00d-a5d3-462b-9252-141cae62b2a2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.177539 Aug 24 03:42:47.940301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 361/719] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:47 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:48.963205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:48.964001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:48.970875 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.971427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.971867 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:48.972556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:48.973006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:48.973425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:49.119774 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.128621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.130481 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:49.131641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2ace9286-2743-425a-881f-21d6a8cab3e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.172352 Aug 24 03:42:49.132196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 359/720] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:48 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:50.154813 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:50.155418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:50.158254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=26 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:50.163655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:50.164164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:50.164597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:50.165298 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:50.165750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:50.166176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:50.311340 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:50.320499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:50.322001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:50.323175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-00675b06-2364-4c50-a114-92c3cb2e29fc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.172281 Aug 24 03:42:50.323751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 362/721] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:50 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:50.607960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-dcec7e09-12f5-43e4-b691-1af8d27ce4fe req-63cd8dd5-d306-4ef6-b904-99d24e831944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e834164b-a670-4f2a-8322-0d968d8e6703", "name": "network-vif-plugged", "status": "completed", "tag": "0f8767fa-c35d-4362-bf07-a72ca2d4c311"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:42:50.618123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-dcec7e09-12f5-43e4-b691-1af8d27ce4fe req-63cd8dd5-d306-4ef6-b904-99d24e831944 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:50.618636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-dcec7e09-12f5-43e4-b691-1af8d27ce4fe req-63cd8dd5-d306-4ef6-b904-99d24e831944 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:50.619067 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-dcec7e09-12f5-43e4-b691-1af8d27ce4fe req-63cd8dd5-d306-4ef6-b904-99d24e831944 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:50.631334 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-dcec7e09-12f5-43e4-b691-1af8d27ce4fe req-63cd8dd5-d306-4ef6-b904-99d24e831944 service nova] Creating event network-vif-plugged:0f8767fa-c35d-4362-bf07-a72ca2d4c311 for instance e834164b-a670-4f2a-8322-0d968d8e6703 on hv-cinder-85426 Aug 24 03:42:50.636503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-dcec7e09-12f5-43e4-b691-1af8d27ce4fe req-63cd8dd5-d306-4ef6-b904-99d24e831944 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107778 Aug 24 03:42:50.637435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 360/722] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:51.347576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:51.348218 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:51.354706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.355192 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.355632 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.356564 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:51.357211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:51.357211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:51.505840 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:51.514967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:51.517037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:51.518230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-08358263-50b6-48db-94ef-9e05c103fbbd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.175898 Aug 24 03:42:51.519170 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 363/723] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:51 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:52.541413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:52.542129 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:52.544662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=26 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:52.550770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.551251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.551682 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.552369 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:52.552821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:52.553244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:52.683907 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:52.694065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:52.695426 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:52.696601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d5c54767-d1fd-4b5c-8922-a02181600e51 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.159423 Aug 24 03:42:52.697161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 361/724] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:52 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:53.722689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:53.723435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:53.733444 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.734313 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.735708 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.736851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:53.737588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:53.738365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:53.910981 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:53.932011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:53.933508 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:53.939087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5dd86f58-9718-4797-8142-5df118c1132a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1809 microversion: 2.20 time: 0.223408 Aug 24 03:42:53.954491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 364/725] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:53 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:54.963014 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:54.963622 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:54.970210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:54.970695 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:54.971139 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:54.971833 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:54.972287 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:54.972743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:55.105610 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:55.114449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:55.115967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:42:55.117115 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f6d150bf-749b-4405-9186-a144d2a46477 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1796 microversion: 2.20 time: 0.158226 Aug 24 03:42:55.117668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 362/726] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:42:54 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1796 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:43:06.469687 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:06.472005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:06.474567 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=5 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:06.475217 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=23 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:06.480764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:06.481240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:06.481678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:06.482400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:06.482857 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:06.483282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:06.557391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-dcbc20a1-172e-4f36-aab0-531b4910a4cc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "POST /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/action" status: 202 len: 0 microversion: 2.1 time: 0.091424 Aug 24 03:43:06.558322 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 365/727] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:43:06 2022] POST /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:43:06.567454 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:06.568139 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:06.570742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:06.571410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=31 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:06.577123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:06.577613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:06.578054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:06.578793 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:06.579880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:06.580340 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:06.762437 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:06.771874 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7f5a4108-1bf1-411a-bfae-5888c76bfda4 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1750 microversion: 2.1 time: 0.208824 Aug 24 03:43:06.772459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 363/728] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:06 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1750 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:07.794006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:07.794728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:07.801204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:07.801694 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:07.802123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:07.802849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:07.803308 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:07.803736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:07.967139 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:07.975548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d91e72b3-01d4-4207-97c5-f74f7edc3033 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.186203 Aug 24 03:43:07.976119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 366/729] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:07 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:08.996901 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:08.997513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:09.003915 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.004395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.004824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.005505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:09.005955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:09.006407 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:09.160348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:09.168484 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-081fdb26-d8b9-4566-9b5e-f83ec1d6c4fb tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.175454 Aug 24 03:43:09.169044 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 364/730] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:08 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:10.189543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:10.190145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:10.196109 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:10.196587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:10.197020 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:10.197700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:10.198152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:10.198612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:10.342644 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:10.351634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e60c23ce-0272-4a58-b175-b3872f0f213c tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.166412 Aug 24 03:43:10.352201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 367/731] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:10 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:11.373204 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:11.373735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:11.380761 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.381245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.381682 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.382406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:11.382874 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:11.383289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:11.525721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:11.533882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-352163ab-dd7c-4eb4-8c21-49d49db6e6e9 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.164724 Aug 24 03:43:11.534598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 365/732] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:11 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:12.555848 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:12.556501 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:12.562496 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:12.563004 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:12.563947 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:12.564647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:12.565101 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:12.565527 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:12.726341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:12.734517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b22a8b46-b9c0-4571-a506-e46b7d9abd31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.183289 Aug 24 03:43:12.735107 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 368/733] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:12 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:13.755390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:13.755991 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:13.762531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:13.763015 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:13.763453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:13.764170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:13.764626 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:13.765050 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:13.909476 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:13.917728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9607871b-8d2f-4a7e-a3f3-00ae02e52483 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.166236 Aug 24 03:43:13.918323 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 366/734] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:13 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:14.939480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:14.940113 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:14.946564 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.947050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.947493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:14.948199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:14.948651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:14.949108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:15.092981 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:15.102778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2c36aaa4-b332-455d-8d37-c926d439b633 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.167271 Aug 24 03:43:15.103361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 369/735] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:14 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:16.123972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:16.124601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:16.131755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.132246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.132683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.133385 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.133843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.134292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.288856 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:16.297304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cb4593e3-e2e6-4fd5-86f2-e43dcdf4591f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.177087 Aug 24 03:43:16.298505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 367/736] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:16 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:16.981749 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "227e4dec-7478-4be2-9118-3bc2fd5583ca"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:16.984204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:16.990438 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.990923 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.991349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:16.992046 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:16.992492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:16.992962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.285514 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-68a99cc6-ca73-4862-bbea-eca3e93aafbb tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428470 Aug 24 03:43:17.286142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 370/737] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:43:16 2022] POST /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:17.320038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:17.320649 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:17.327246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.327729 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.328159 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.328882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:17.329534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:17.329961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:17.507043 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:17.517345 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8637de6f-a415-46db-8edf-6caef2ad6d5a tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.200977 Aug 24 03:43:17.517935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 368/738] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:17 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:18.539490 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:18.540192 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:18.547356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.547839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.548291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.549056 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:18.549520 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:18.549944 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:18.697145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:18.706163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-776da354-f417-4137-841b-7f09cfe05142 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.171366 Aug 24 03:43:18.706764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 371/739] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:18 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:19.727583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:19.728161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:19.734613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:19.735106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:19.735533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:19.736236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:19.736676 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:19.737095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:19.883167 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:19.891913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-337b7f3b-5c4a-4c03-b090-3967251cf079 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.167789 Aug 24 03:43:19.892483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 369/740] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:19 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:20.912662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:20.913397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:20.920395 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.920876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.921322 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:20.921996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:20.922513 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:20.922937 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.076692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:21.085364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c3085252-633b-49fe-9d83-078cc1c881fc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.176798 Aug 24 03:43:21.085928 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 372/741] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:20 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:22.106743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:22.107454 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:22.114309 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.114794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.115226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.115921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.116379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.116816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.285279 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:22.293568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f9702069-6841-4bae-ba64-b7c30e4cd08f tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.190760 Aug 24 03:43:22.294135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 370/742] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:22 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:23.315862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:23.316477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:23.322888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.323373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.323811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.324502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.324959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.325386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.480364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:23.489137 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f3f00c9f-d950-40d1-bc84-b6283c475c02 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1755 microversion: 2.1 time: 0.177754 Aug 24 03:43:23.489698 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 373/743] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:23 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:24.521559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:24.522330 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:24.528782 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.529256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.529689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.530403 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.530853 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.531273 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.677780 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:24.686345 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9e43ea22-18d0-4c05-b6ee-17f3a1ead220 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1758 microversion: 2.1 time: 0.178366 Aug 24 03:43:24.686939 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 371/744] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:24 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:26.953085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:26.955430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:26.962065 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.962601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.963039 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.963732 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.964186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.964609 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.990007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lazy-loading 'flavor' on Instance uuid 6560bb95-66b1-4d4f-a87b-4bc63cd92674 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:43:27.198915 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-708a10a1-6dac-478d-a074-8a72cd40efb6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/action" status: 200 len: 32 microversion: 2.1 time: 0.249376 Aug 24 03:43:27.199504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 374/745] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:43:26 2022] POST /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:43:27.210411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:27.211292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:27.218255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.218817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.219267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.220612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.221073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.221506 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.444683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:27.453369 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a1effc15-6e80-4d66-ac6c-f419854c261b tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.247581 Aug 24 03:43:27.454528 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 372/746] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:27 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:27.835879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:43:27.836234 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 03:43:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:43:28.476051 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:28.476743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:28.486018 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.486535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.486978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.487683 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.488139 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.488577 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.632351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:28.642423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9646da6c-0a26-4f2c-9449-5afc53d50663 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.170843 Aug 24 03:43:28.643240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 375/747] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:28 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:29.664223 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:29.664825 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:29.671289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.671764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.672192 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.672865 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.673398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.673787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.807904 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:29.816577 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-be3469e4-d10e-419e-b1b2-e0be4d4a7533 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.156190 Aug 24 03:43:29.817125 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 373/748] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:29 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:30.838046 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:30.838708 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:30.845874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.846392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.846826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.847515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.847968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.848389 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.987333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:30.995498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c2bf5cce-ba97-4e9e-a703-5a40e9c86c28 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.161273 Aug 24 03:43:30.996054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 376/749] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:30 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:32.018017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:32.018642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:32.025016 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.025501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.025941 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:32.026662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.027120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.027545 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:32.155482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:32.164176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-32bb5c00-5126-4b9f-a2a3-e076645d23cd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.150059 Aug 24 03:43:32.164731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 374/750] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:32 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:33.185159 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:33.185775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:33.192746 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:33.193230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:33.193668 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.194462 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:33.194921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:33.195344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.199433 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:33.332603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:33.340920 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5c61e39f-8b7c-4925-98b1-346b24b09670 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.159862 Aug 24 03:43:33.341497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 377/751] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:33 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:34.364647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:34.365555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:34.375337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.376649 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.377378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.378841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.379144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.379839 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.510736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:34.519786 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-62cc8aeb-fc7f-4453-830f-929793ac4c87 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.160927 Aug 24 03:43:34.520344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 375/752] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:34 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:35.540282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:35.540839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:35.547137 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.547917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.548368 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.549045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.549490 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.549905 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.682357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:35.691110 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0e5d9e49-35e5-4ee2-851f-46c88c7e42f4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.154811 Aug 24 03:43:35.691678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 378/753] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:35 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:36.715842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:36.716888 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:36.720924 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=27 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:36.727270 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.727767 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.728206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.728917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.729378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.729808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.732930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=79 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:36.897999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:36.906656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-04241e7b-b3e1-4c56-87ec-cefbbc04580c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.197357 Aug 24 03:43:36.907806 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 376/754] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:36 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:37.928482 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:37.929063 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:37.931786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=29 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:37.937123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.937603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.938036 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:37.939285 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.939729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.940149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.108664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:38.116958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f53f32ed-3107-4b52-ad45-68d782ce9797 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.192266 Aug 24 03:43:38.117517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 379/755] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:37 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:39.139854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:39.140570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:39.148073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.148557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.148989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.149692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.150152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.150592 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.288196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:39.296887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cef1d261-d9d0-4eb3-8f6e-840032e7a088 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.160924 Aug 24 03:43:39.297451 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 377/756] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:39 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:40.319456 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:40.320017 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:40.327001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:40.327488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:40.327929 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:40.328618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:40.329074 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:40.329498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:40.463487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:40.472477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a4f5322f-e2f6-4503-abcc-0fd8c45bccdc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.157018 Aug 24 03:43:40.473112 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 380/757] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:40 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:41.494977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:41.495626 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:41.502727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.503216 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.503655 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.504358 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.504818 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.505245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.638984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:41.647310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3a608a89-c1ae-4094-a1c2-3d48747148dc tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.156128 Aug 24 03:43:41.647865 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 378/758] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:41 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:42.668714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:42.669300 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:42.675797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:42.676277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:42.676704 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:42.677386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:42.677831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:42.678274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:42.809267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:42.819116 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c81cacaf-b798-46f2-8cef-898d085569e8 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.154520 Aug 24 03:43:42.819690 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 381/759] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:42 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:43.840759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:43.841368 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:43.848601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.849084 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.849511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:43.850210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.850738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.851161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:43.984208 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:43.992892 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-93cb9505-f4a8-4014-9b4d-215468d71c84 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.156189 Aug 24 03:43:43.993452 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 379/760] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:43 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:45.015742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:45.016440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:45.024047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:45.024564 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:45.025004 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:45.025697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:45.026154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:45.026615 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:45.159764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:45.168440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b1c672ed-a60f-45a3-9d5d-a304d8a10edf tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.156586 Aug 24 03:43:45.169112 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 382/761] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:45 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:46.190666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:46.191270 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:46.197634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:46.198107 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:46.198581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:46.199255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:46.199704 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:46.200119 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:46.331756 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:46.340204 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-215b210d-9861-43ae-9503-6153148747e0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.153944 Aug 24 03:43:46.340770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 380/762] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:46 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:47.361300 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:47.362481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:47.369089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:47.369576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:47.370017 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:47.370762 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:47.371220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:47.371650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:47.502838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:47.511077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-401e2fe4-4f21-4d4e-a909-0caae7cbd67c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1736 microversion: 2.1 time: 0.153674 Aug 24 03:43:47.511645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 383/763] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:47 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:48.531714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:48.532333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:48.539008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.539487 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.539952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.540645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.541093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.541515 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.674729 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:48.683434 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a84c46d4-88ab-4ffc-9bf9-58eb3390c7fd tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1716 microversion: 2.1 time: 0.155671 Aug 24 03:43:48.684011 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 381/764] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:48 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:48.743608 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:48.744125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:48.750688 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.751178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.751623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.752360 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.752813 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.753248 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.887537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] HTTP exception thrown: Cannot 'detach_volume' instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 while it is in vm_state rescued Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Request method failure captured: Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments/227e4dec-7478-4be2-9118-3bc2fd5583ca HTTP/1.1 Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzS_5Z0sC_TjWAR5UuUsSS6N-Xmad3SK7CRSIuSAYRNL7uR3byKKjlG0zlW7pk9avvW8cHFgWM7ApKI4DSC6o_h306gtHD_oXQ1re2A8G5jwylKiyVkBxfDPwq8etbqFD6yNjb07nZrGEK9f0-weChEHLkee0f9hcbv1ETzXr2SmGU Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:43:48.889149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 76c0df49fa9342778a56eae098b2f2cd Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:43:48.890798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Cannot 'detach_volume' instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 while it is in vm_state rescued Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'server_id': '6560bb95-66b1-4d4f-a87b-4bc63cd92674', 'id': '227e4dec-7478-4be2-9118-3bc2fd5583ca'} Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:48.891653 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 while it is in vm_state rescued Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 while it is in vm_state rescued Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:48.893589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Returning 409 to user: Cannot 'detach_volume' instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 while it is in vm_state rescued {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:48.894691 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a1dabc1a-d2fe-42c5-91d8-eec84a72be9a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "DELETE /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments/227e4dec-7478-4be2-9118-3bc2fd5583ca" status: 409 len: 152 microversion: 2.1 time: 0.150937 Aug 24 03:43:48.894691 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 384/765] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:43:48 2022] DELETE /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments/227e4dec-7478-4be2-9118-3bc2fd5583ca => generated 152 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:43:48.900258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:48.900792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:48.906918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.907402 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.907843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.909152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:48.909609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:48.910036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:48.985107 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-07419384-46cf-475d-8b66-c7f74444597e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "POST /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/action" status: 202 len: 0 microversion: 2.1 time: 0.087607 Aug 24 03:43:48.986157 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 382/766] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:43:48 2022] POST /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:43:48.994538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:48.995296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:49.002784 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:49.006146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:49.006146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:49.006146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:49.006146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:49.006504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:49.151700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:49.159886 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2f3a8604-b31b-4579-82e8-181e8d1b3570 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1724 microversion: 2.1 time: 0.169174 Aug 24 03:43:49.160451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 385/767] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:48 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:50.181737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:50.182713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:50.189399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:50.190423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:50.190855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:50.191575 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:50.192196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:50.192418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:50.329737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:50.338412 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-781c29f8-3f06-4759-8b75-e57238bf0e3c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1724 microversion: 2.1 time: 0.160846 Aug 24 03:43:50.338970 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 383/768] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:50 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:51.360127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:51.360678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:51.367067 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:51.367546 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:51.367982 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:51.368671 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:51.369128 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:51.369556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:51.745172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:51.754031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6a01b8a4-dbb5-4ea1-b21e-f39a45cd8f4c tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1724 microversion: 2.1 time: 0.397868 Aug 24 03:43:51.754641 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 386/769] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:51 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:52.776416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:52.777222 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:52.784388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:52.784855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:52.785436 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:52.786311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:52.786762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:52.787178 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:52.933349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:52.942338 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-49e22861-cd97-441d-8d87-6200bf211a65 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1724 microversion: 2.1 time: 0.170294 Aug 24 03:43:52.942957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 384/770] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:52 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:53.963916 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:53.964527 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:53.971431 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.971908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.972347 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:53.973032 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:53.973488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:53.973915 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:54.101123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:54.109374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-70dc0132-d8cc-4a4a-9712-d0660d759bce tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1730 microversion: 2.1 time: 0.149286 Aug 24 03:43:54.109938 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 387/771] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:53 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:54.129348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:54.129877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:54.136400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:54.136884 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:54.137321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:54.138009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:54.138494 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:54.138917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:54.218131 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-10be6a4d-6ff2-46c9-a71c-8ca2412ee082 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092397 Aug 24 03:43:54.218819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 385/772] 10.222.0.91 () {58 vars in 1275 bytes} [Wed Aug 24 03:43:54 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:55.384146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-56855136-831d-410f-9771-4d22c475b11c req-e0f7dd87-1ffa-49e3-8c33-275b4b71a71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6560bb95-66b1-4d4f-a87b-4bc63cd92674", "tag": "38238e64-0e40-4fe3-b325-5d4013cfe9ab"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:55.394301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-56855136-831d-410f-9771-4d22c475b11c req-e0f7dd87-1ffa-49e3-8c33-275b4b71a71d service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:55.394857 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-56855136-831d-410f-9771-4d22c475b11c req-e0f7dd87-1ffa-49e3-8c33-275b4b71a71d service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:55.395395 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-56855136-831d-410f-9771-4d22c475b11c req-e0f7dd87-1ffa-49e3-8c33-275b4b71a71d service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:55.407889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-56855136-831d-410f-9771-4d22c475b11c req-e0f7dd87-1ffa-49e3-8c33-275b4b71a71d service nova] Creating event network-changed:38238e64-0e40-4fe3-b325-5d4013cfe9ab for instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 on hv-cinder-85426 Aug 24 03:43:55.414833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-56855136-831d-410f-9771-4d22c475b11c req-e0f7dd87-1ffa-49e3-8c33-275b4b71a71d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098822 Aug 24 03:43:55.415551 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 388/773] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:56.808836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:56.809449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:56.815798 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.816269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.816699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.817381 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.817829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.818267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.840921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5c6116a6-9b52-48ad-b168-074f07e4230e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785/ips" status: 200 len: 149 microversion: 2.1 time: 0.036643 Aug 24 03:43:56.841450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 386/774] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:43:56 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:56.853914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0d149dd-e9e7-43ec-a3ee-633e78920404"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:56.856344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:56.863643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.864123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.864555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.865248 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.865706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.866249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.946872 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Invalid volume: volume b0d149dd-e9e7-43ec-a3ee-633e78920404 is already attached to instances: 88860171-756d-4701-a8e0-095fd12fa4e6 Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: POST /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785/os-volume_attachments HTTP/1.1 Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 74 Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:43:56.948675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {"volumeAttachment": {"volumeId": "b0d149dd-e9e7-43ec-a3ee-633e78920404"}} Aug 24 03:43:56.950282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Invalid volume: volume b0d149dd-e9e7-43ec-a3ee-633e78920404 is already attached to instances: 88860171-756d-4701-a8e0-095fd12fa4e6 Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'server_id': '2c09002f-a0ab-4747-8932-0b86085e8785', 'body': {'volumeAttachment': {'volumeId': 'b0d149dd-e9e7-43ec-a3ee-633e78920404'}}} Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b0d149dd-e9e7-43ec-a3ee-633e78920404 is already attached to instances: 88860171-756d-4701-a8e0-095fd12fa4e6 Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.951189 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b0d149dd-e9e7-43ec-a3ee-633e78920404 is already attached to instances: 88860171-756d-4701-a8e0-095fd12fa4e6 Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:43:56.952587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:43:56.953983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:43:56.953983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:43:56.953983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:43:56.953983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b0d149dd-e9e7-43ec-a3ee-633e78920404 is already attached to instances: 88860171-756d-4701-a8e0-095fd12fa4e6 Aug 24 03:43:56.953983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:43:56.953983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 400 to user: Invalid volume: volume b0d149dd-e9e7-43ec-a3ee-633e78920404 is already attached to instances: 88860171-756d-4701-a8e0-095fd12fa4e6 {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:43:56.953983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1a33b53f-0a84-4b94-9a98-68beacb26099 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100547 Aug 24 03:43:56.953983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 389/775] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:43:56 2022] POST /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:43:56.960158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:56.960647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:56.966548 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.967022 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.967449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.968123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:56.968572 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:56.968991 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:56.995039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:43:57.072639 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7245b832-f269-4047-9e3e-955640fea86f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 204 len: 0 microversion: 2.1 time: 0.115856 Aug 24 03:43:57.073144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 387/776] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:43:56 2022] DELETE /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:43:57.082442 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:57.083059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:57.090334 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.090831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.091337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.091971 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.092600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.092920 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.230237 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:57.238366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-caaba2eb-b561-4c8f-8eeb-5f1eae5a88bd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1679 microversion: 2.1 time: 0.160771 Aug 24 03:43:57.238924 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 390/777] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:57 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:57.431186 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-72646f8f-de6f-4498-ab5a-171cec0a7661 req-812d9784-0f29-4ec3-b429-82cc432ed913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6560bb95-66b1-4d4f-a87b-4bc63cd92674", "tag": "38238e64-0e40-4fe3-b325-5d4013cfe9ab"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:57.441414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-72646f8f-de6f-4498-ab5a-171cec0a7661 req-812d9784-0f29-4ec3-b429-82cc432ed913 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:57.441882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-72646f8f-de6f-4498-ab5a-171cec0a7661 req-812d9784-0f29-4ec3-b429-82cc432ed913 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:57.442339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-72646f8f-de6f-4498-ab5a-171cec0a7661 req-812d9784-0f29-4ec3-b429-82cc432ed913 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:57.454383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-72646f8f-de6f-4498-ab5a-171cec0a7661 req-812d9784-0f29-4ec3-b429-82cc432ed913 service nova] Creating event network-changed:38238e64-0e40-4fe3-b325-5d4013cfe9ab for instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 on hv-cinder-85426 Aug 24 03:43:57.459348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-72646f8f-de6f-4498-ab5a-171cec0a7661 req-812d9784-0f29-4ec3-b429-82cc432ed913 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032272 Aug 24 03:43:57.459906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 388/778] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:58.259333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:58.259934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:58.266284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:58.266757 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:58.267547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.268369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:58.268824 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:58.269249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:58.396034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:58.403625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2668e014-ca4c-4325-9979-ee2fe71dd135 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1679 microversion: 2.1 time: 0.148116 Aug 24 03:43:58.404180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 391/779] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:58 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:59.426254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:59.426950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:59.433760 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.434260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.434696 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.435387 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:59.435831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:59.436250 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:59.615528 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:59.623182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ba828e2a-9da4-411b-8bd3-b7cb1e0586b4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1679 microversion: 2.1 time: 0.202033 Aug 24 03:43:59.623744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 389/780] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:59 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:00.295960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-2cf53c19-4161-423c-8c75-ade53dfe05bd req-a358d20a-4bb7-422a-b5cf-753addbccca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c09002f-a0ab-4747-8932-0b86085e8785", "name": "network-vif-deleted", "tag": "d9fd34e0-e020-4b53-9a95-9ee189ca2343"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:00.306886 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-2cf53c19-4161-423c-8c75-ade53dfe05bd req-a358d20a-4bb7-422a-b5cf-753addbccca5 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.307914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-2cf53c19-4161-423c-8c75-ade53dfe05bd req-a358d20a-4bb7-422a-b5cf-753addbccca5 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.308502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-2cf53c19-4161-423c-8c75-ade53dfe05bd req-a358d20a-4bb7-422a-b5cf-753addbccca5 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.321156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-2cf53c19-4161-423c-8c75-ade53dfe05bd req-a358d20a-4bb7-422a-b5cf-753addbccca5 service nova] Creating event network-vif-deleted:d9fd34e0-e020-4b53-9a95-9ee189ca2343 for instance 2c09002f-a0ab-4747-8932-0b86085e8785 on hv-cinder-85426 Aug 24 03:44:00.326815 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-2cf53c19-4161-423c-8c75-ade53dfe05bd req-a358d20a-4bb7-422a-b5cf-753addbccca5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102987 Aug 24 03:44:00.327984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 392/781] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:00.609349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:00.610598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:00.617268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.617842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.618396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.619333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.620000 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.620666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.645959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:00.646996 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.objects.instance [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lazy-loading 'flavor' on Instance uuid dc6e4c30-7ab0-446f-8f76-078a95397938 {{(pid=127260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:00.647299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:00.654123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.654927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.655568 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.656555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.657015 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.657682 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.680756 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:00.693990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.694493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.695180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.695620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lazy-loading 'fault' on Instance uuid 2c09002f-a0ab-4747-8932-0b86085e8785 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:00.747273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:00.757034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ec402b2f-1cd0-4ee2-a93e-2f449ab75f2e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 200 len: 1331 microversion: 2.1 time: 0.115580 Aug 24 03:44:00.762846 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 393/782] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:00 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:00.777632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-fe0f081c-66fa-4ed3-8495-b4cd3f033471 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "POST /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938/action" status: 202 len: 0 microversion: 2.1 time: 0.280681 Aug 24 03:44:00.778709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 390/783] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:44:00 2022] POST /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:00.787313 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:00.788910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:00.798717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.800146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.801028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.802647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:00.803302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:00.805573 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:00.978508 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:00.982165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:00.993409 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c59026c7-0e64-4dd8-a079-802a6c5e16f3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.209708 Aug 24 03:44:00.995836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 394/784] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:00 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:01.786368 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:01.787191 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:01.793480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:01.793967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:01.794436 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:01.795144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:01.795603 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:01.796049 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:01.810621 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 HTTP/1.1 Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:44:01.812269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:44:01.813913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '2c09002f-a0ab-4747-8932-0b86085e8785'} Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:01.814877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:44:01.816395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:01.818247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:01.818247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9cee992b-7a8e-49b5-9088-299a4a84f411 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 404 len: 111 microversion: 2.1 time: 0.033108 Aug 24 03:44:01.818247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 391/785] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:01 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:44:01.823529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7136dada-b79d-4db8-a3aa-ab226420b60a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '.version_select at 0x7f077f9bff70>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:01.847158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7136dada-b79d-4db8-a3aa-ab226420b60a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894544252" status: 202 len: 0 microversion: 2.1 time: 0.027398 Aug 24 03:44:01.847734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 395/786] 10.222.0.91 () {58 vars in 1218 bytes} [Wed Aug 24 03:44:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894544252 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:02.016318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:02.017047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:02.040215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.040708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.041215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.042006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.042592 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.043233 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.217643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:02.229105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1a14db53-7444-4994-86bb-1d2dc44c4c8e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.216568 Aug 24 03:44:02.229454 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 392/787] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:02 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:02.574068 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:02.574586 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:02.581039 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.581520 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.581950 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.582673 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.583129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.583550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.663377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lazy-loading 'services' on Instance uuid 88860171-756d-4701-a8e0-095fd12fa4e6 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:02.775221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-39ca8f30-9f82-4be7-a5ae-513eced509b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments/b0d149dd-e9e7-43ec-a3ee-633e78920404" status: 202 len: 0 microversion: 2.1 time: 0.204907 Aug 24 03:44:02.775824 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 396/788] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:44:02 2022] DELETE /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments/b0d149dd-e9e7-43ec-a3ee-633e78920404 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:02.785053 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:02.787662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:02.794671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.795158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.795601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.796326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:02.796779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:02.797206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:02.828730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8b3cdd04-75d0-4d54-9ed4-a521740dcb8b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048342 Aug 24 03:44:02.829290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 393/789] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:44:02 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:03.252165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:03.253421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:03.259536 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.260020 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.260455 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.261146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.261600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.262028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.405937 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:03.414163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-262288ab-3784-421e-952f-0170e3661013 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.167014 Aug 24 03:44:03.414739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 397/790] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:03 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:03.840864 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:03.843146 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:03.850458 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.850945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.851382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.852079 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:03.852533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:03.852961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:03.884172 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c8b17999-a728-467f-acc7-80e6af7ca057 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047162 Aug 24 03:44:03.884730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 394/791] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:44:03 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:04.436047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:04.436663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:04.443902 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:04.444389 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:04.444825 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.445509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:04.445962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:04.446415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.574513 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:04.582252 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a61d92bc-4a8a-40d7-b649-cefd675f2a1e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.150281 Aug 24 03:44:04.582810 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 398/792] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:04 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:04.896593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:04.899132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:04.905170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:04.905658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:04.906622 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.907306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:04.907765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:04.908779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:04.938083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7aac7b44-16b6-4703-9139-8dff1cb640ec tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045456 Aug 24 03:44:04.938909 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 395/793] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:44:04 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:44:04.999755 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:05.000381 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:05.006360 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:05.006844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:05.007284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:05.007973 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:05.008427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:05.008856 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:05.033172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Going to try to terminate instance {{(pid=127259) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:44:05.108802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-34cab127-4212-45e7-bec6-7bb51b99e942 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 204 len: 0 microversion: 2.1 time: 0.112532 Aug 24 03:44:05.109503 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 399/794] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:44:04 2022] DELETE /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:44:05.119884 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:05.120392 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:05.126410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:05.126895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:05.127361 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:05.128026 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:05.128470 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:05.128911 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:05.260503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:05.269182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-46352099-8ef3-4965-9b7a-92409baf50b2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1680 microversion: 2.1 time: 0.153248 Aug 24 03:44:05.269742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 396/795] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:05 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:05.604523 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:05.605130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:05.611612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:05.612095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:05.612528 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:05.613841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:05.614320 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:05.614744 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:05.761803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:05.770198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-53bf5601-c277-473e-9d4d-333ecc07bfad tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.169573 Aug 24 03:44:05.770768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 400/796] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:05 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:06.290269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:06.290800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:06.297190 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:06.297667 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:06.298103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:06.298813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:06.299263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:06.299684 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:06.436571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:06.445377 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-265900df-079b-4bee-8e80-216505ac4eab tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1680 microversion: 2.1 time: 0.159013 Aug 24 03:44:06.445954 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 397/797] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:06 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:06.791792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:06.792505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:06.798967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:06.799527 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:06.800033 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:06.801292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:06.801827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:06.802370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:06.999190 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:07.007493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a6ae1331-ed83-4f01-ad82-0264c501442e tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.219525 Aug 24 03:44:07.008056 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 401/798] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:06 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:07.343072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-21b3edf7-1ba4-49b8-9f25-093dd52f93dc req-38784ab6-737f-466e-a55e-6be10178061f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88860171-756d-4701-a8e0-095fd12fa4e6", "name": "network-vif-deleted", "tag": "c4edcf8c-59e5-415c-bc26-f08f91e47a56"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:07.349050 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:07.355181 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-21b3edf7-1ba4-49b8-9f25-093dd52f93dc req-38784ab6-737f-466e-a55e-6be10178061f service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:07.355896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-21b3edf7-1ba4-49b8-9f25-093dd52f93dc req-38784ab6-737f-466e-a55e-6be10178061f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:07.356948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-21b3edf7-1ba4-49b8-9f25-093dd52f93dc req-38784ab6-737f-466e-a55e-6be10178061f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:07.372183 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-21b3edf7-1ba4-49b8-9f25-093dd52f93dc req-38784ab6-737f-466e-a55e-6be10178061f service nova] Creating event network-vif-deleted:c4edcf8c-59e5-415c-bc26-f08f91e47a56 for instance 88860171-756d-4701-a8e0-095fd12fa4e6 on hv-cinder-85426 Aug 24 03:44:07.379533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-21b3edf7-1ba4-49b8-9f25-093dd52f93dc req-38784ab6-737f-466e-a55e-6be10178061f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Aug 24 03:44:07.380233 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 398/799] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:07.467749 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:07.469231 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:07.477419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:07.478619 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:07.479296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:07.480235 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:07.480768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:07.481265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:07.516118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:07.516857 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:07.517454 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:07.518065 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lazy-loading 'fault' on Instance uuid 88860171-756d-4701-a8e0-095fd12fa4e6 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:07.579198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:07.587593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fe2ea0ef-9093-4b6d-a0a7-a23d68b41fa7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 200 len: 1330 microversion: 2.1 time: 0.123888 Aug 24 03:44:07.588172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 402/800] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:07 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 1330 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:08.028715 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:08.029415 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:08.035995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:08.036483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:08.036920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:08.037610 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:08.038062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:08.038514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:08.179450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:08.187937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-afab55f4-56da-4d84-80e0-e631f8162a2a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.163332 Aug 24 03:44:08.188526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 399/801] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:08 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:08.609676 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:08.610307 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:08.612740 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:08.618917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:08.619400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:08.619835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:08.620524 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:08.620978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:08.621401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:08.637964 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 HTTP/1.1 Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:44:08.639554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:44:08.641162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '88860171-756d-4701-a8e0-095fd12fa4e6'} Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:08.643085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:44:08.644449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:08.645575 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:08.645575 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0b46cbad-98a4-4ab8-aecd-98ce7f6de50c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 404 len: 111 microversion: 2.1 time: 0.035242 Aug 24 03:44:08.645575 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 403/802] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:08 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:44:08.650005 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9c3b9c57-a3f9-4ce5-8c4d-fb1c36761d24 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '.version_select at 0x7f077c1319d0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:08.675032 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9c3b9c57-a3f9-4ce5-8c4d-fb1c36761d24 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653821510" status: 202 len: 0 microversion: 2.1 time: 0.028814 Aug 24 03:44:08.675599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 400/803] 10.222.0.91 () {58 vars in 1218 bytes} [Wed Aug 24 03:44:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653821510 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:09.209286 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:09.209917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:09.216152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:09.216574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:09.217013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:09.217712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:09.218167 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:09.218604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:09.320447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bf592abe-3706-4e60-947a-5b8b285f4915 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: .version_select at 0x7f077c0f9160>, body: {"keypair": {"name": "tempest-keypair-1670193695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCexbm3B6PLqHExd826XaHZsF+4LuCD2ecwIGEM2m7sL0W9ur4oWRxw8Ktwjc2WxV16bqQW1AsWR73QW+/DJwMQUna5kb8hupM8KhZmwMdOAEpX7Lg7STWikmqgI6L3fGg=="}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:09.338946 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-bf592abe-3706-4e60-947a-5b8b285f4915 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for project c7c94d613f6b440bae60fc442661c671. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:09.344583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-bf592abe-3706-4e60-947a-5b8b285f4915 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for user b1d9d5fd0db54ddf85e05c77dd7f6c89 and project c7c94d613f6b440bae60fc442661c671. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:09.366959 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bf592abe-3706-4e60-947a-5b8b285f4915 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050966 Aug 24 03:44:09.368920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 401/804] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:44:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:09.377566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:09.382554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b2c13a5b-e3b4-4094-a86a-56e812a91dee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.177041 Aug 24 03:44:09.383123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 404/805] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:09 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:10.403910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:10.404505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:10.411536 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:10.412025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:10.412459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:10.413161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:10.413614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:10.414039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:10.560523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:10.578755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ae410382-c812-40b1-ae68-7e57b0ad0a48 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.179190 Aug 24 03:44:10.579622 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 402/806] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:10 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:10.617783 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-672775082", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "179f4006-1dcb-402a-823f-dec3eb79c3e6"}], "security_groups": [{"name": "tempest-securitygroup--533564743"}], "key_name": "tempest-keypair-1670193695", "user_data": "}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:10.724616 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] validate_networks() for [('179f4006-1dcb-402a-823f-dec3eb79c3e6', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:44:11.167915 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:11.168335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:11.168800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:11.169200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:11.169604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:11.178315 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.178792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.179221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:11.179926 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.180370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.180788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:11.197451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for project c7c94d613f6b440bae60fc442661c671. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:11.201298 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for user b1d9d5fd0db54ddf85e05c77dd7f6c89 and project c7c94d613f6b440bae60fc442661c671. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:11.212512 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:44:11.214754 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:44:11.272015 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5e77907e-8c49-465a-9575-26cc280231ee tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.658301 Aug 24 03:44:11.272658 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 405/807] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:44:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:44:11.283487 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-70abdd2b-4081-4f52-93ec-8d3f6934516a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:11.284145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-70abdd2b-4081-4f52-93ec-8d3f6934516a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:11.347225 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-70abdd2b-4081-4f52-93ec-8d3f6934516a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:11.355406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-70abdd2b-4081-4f52-93ec-8d3f6934516a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1241 microversion: 2.1 time: 0.075664 Aug 24 03:44:11.355919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 403/808] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:11 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:11.600237 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:11.601008 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:11.608738 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.609486 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.609975 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:11.610852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.611414 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.611954 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:11.752043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:11.760461 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-95107d22-b946-4312-9321-b351b8c2605f tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.164075 Aug 24 03:44:11.761129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 406/809] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:11 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:11.889045 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:11.889530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:11.896599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.897081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.897514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:11.898219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:11.898680 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:11.899101 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:11.930116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-096f9a3a-fadb-4898-bfab-fba5720041e4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments/6311643b-d401-4134-a325-18a67c849c87" status: 200 len: 194 microversion: 2.20 time: 0.045004 Aug 24 03:44:11.930723 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 404/810] 10.222.0.91 () {60 vars in 1454 bytes} [Wed Aug 24 03:44:11 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments/6311643b-d401-4134-a325-18a67c849c87 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:44:12.001717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:12.002257 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:12.008945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.009679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.010120 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.010839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.011299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.011723 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.094673 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lazy-loading 'services' on Instance uuid e834164b-a670-4f2a-8322-0d968d8e6703 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:12.170547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8081d59b-24c0-449c-8c02-c271e104e0d6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments/6311643b-d401-4134-a325-18a67c849c87" status: 202 len: 0 microversion: 2.20 time: 0.172528 Aug 24 03:44:12.171129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 407/811] 10.222.0.91 () {60 vars in 1457 bytes} [Wed Aug 24 03:44:11 2022] DELETE /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments/6311643b-d401-4134-a325-18a67c849c87 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:44:12.179993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:12.182203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:12.189509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.189982 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.190451 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.191141 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.192173 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.192596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.220918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7957dc95-909d-46cd-bb56-0c8391669cdd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045325 Aug 24 03:44:12.221464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 405/812] 10.222.0.91 () {60 vars in 1343 bytes} [Wed Aug 24 03:44:12 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:44:12.376968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:12.377584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:12.384403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.384882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.385343 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.386029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.386703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.387131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.459055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:12.466794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b88e4192-d881-465a-b898-d512b31e500b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1293 microversion: 2.1 time: 0.094103 Aug 24 03:44:12.467371 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 408/813] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:12 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:12.783796 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:12.784662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:12.793813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.794719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.795367 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.796362 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:12.797096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:12.797814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:12.957939 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:12.965753 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2fb365ac-180e-43ca-8838-cf464b7b00fb tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.186841 Aug 24 03:44:12.966339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 406/814] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:12 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:13.233849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:13.236603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:13.243530 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:13.244014 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:13.244446 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:13.245139 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:13.245583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:13.246001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:13.279102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4c0a00ef-e263-45ae-a919-067a6d85c53c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049804 Aug 24 03:44:13.280012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 409/815] 10.222.0.91 () {60 vars in 1343 bytes} [Wed Aug 24 03:44:13 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:44:13.488105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:13.489374 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:13.495638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:13.496120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:13.496548 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:13.497286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:13.497740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:13.498158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:13.649571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:13.661715 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a709d7c1-381f-4a4f-a687-13f68d576c28 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.176430 Aug 24 03:44:13.662354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 407/816] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:13 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:13.986991 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:13.987964 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:13.994937 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:13.995732 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:13.996205 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:13.996934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:13.997393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:13.997818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.018105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:14.292397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:14.295547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:14.302467 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.302948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.303377 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.304107 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.304521 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.305509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.346058 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8166f24f-d36a-487a-8424-814a0a0e5b93 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057538 Aug 24 03:44:14.346886 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 408/817] 10.222.0.91 () {60 vars in 1343 bytes} [Wed Aug 24 03:44:14 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:14.360201 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:14.369202 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3783cfd3-cb2b-4d5d-b994-1070d2f62dc8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.386017 Aug 24 03:44:14.370368 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 410/818] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:13 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:14.427219 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:14.427708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:14.434398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.434765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.435194 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.436031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.436328 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.436741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.463391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:44:14.488588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:14.552645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a193b6b0-2c74-44ed-921f-4eacc0a6f426 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 204 len: 0 microversion: 2.20 time: 0.128596 Aug 24 03:44:14.553175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 409/819] 10.222.0.91 () {60 vars in 1280 bytes} [Wed Aug 24 03:44:14 2022] DELETE /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:44:14.565389 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:14.568099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:14.575387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.575997 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.576640 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.577492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.578128 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.578647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.629854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-bd499677-97e7-42d6-82ab-ebb8c1f04ad6 req-f83e3662-2de1-4902-898a-653f839f7bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e94e4298-9115-41cc-9220-252b7e0781d1", "tag": "da87d65f-39b6-4d02-8533-ddf918ad0857"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:14.638955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bd499677-97e7-42d6-82ab-ebb8c1f04ad6 req-f83e3662-2de1-4902-898a-653f839f7bd2 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.639427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bd499677-97e7-42d6-82ab-ebb8c1f04ad6 req-f83e3662-2de1-4902-898a-653f839f7bd2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.639856 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bd499677-97e7-42d6-82ab-ebb8c1f04ad6 req-f83e3662-2de1-4902-898a-653f839f7bd2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.651933 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-bd499677-97e7-42d6-82ab-ebb8c1f04ad6 req-f83e3662-2de1-4902-898a-653f839f7bd2 service nova] Creating event network-changed:da87d65f-39b6-4d02-8533-ddf918ad0857 for instance e94e4298-9115-41cc-9220-252b7e0781d1 on hv-cinder-85426 Aug 24 03:44:14.656530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-bd499677-97e7-42d6-82ab-ebb8c1f04ad6 req-f83e3662-2de1-4902-898a-653f839f7bd2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031406 Aug 24 03:44:14.657282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 410/820] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:14.687407 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:14.688096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:14.695124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.695613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.696055 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.696805 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:14.703300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:14.704020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:14.750115 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:14.759412 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:14.760928 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:14.762096 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4160332a-914f-4f6c-be77-9402f671c9e7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.202960 Aug 24 03:44:14.762685 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 411/821] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:14 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:14.840038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:14.848594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b74eb293-d469-48bc-aabd-09a32750a058 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.165959 Aug 24 03:44:14.849198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 411/822] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:14 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:15.392448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:15.392996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:15.399835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.400308 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.400744 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.401441 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.401891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.402418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.540447 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:15.548144 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8db33086-62da-4fd7-9acc-41977b9028b8 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.159677 Aug 24 03:44:15.548708 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 412/823] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:15 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:15.785002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:15.786467 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:15.794497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.794974 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.795413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.796093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.796552 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.796957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.868923 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:15.870261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:15.876270 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.876753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.877186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.877892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:15.878376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:15.878806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:15.927265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:15.935866 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:15.937359 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:15.938566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-38765905-6023-4603-89ec-d196df3adac9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.157424 Aug 24 03:44:15.939120 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 412/824] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:15 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:16.011794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:16.020222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-00286efc-1271-4016-b978-740845ba799c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.154944 Aug 24 03:44:16.020837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 413/825] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:15 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:16.569655 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:16.570286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:16.576941 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:16.577313 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:16.577744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:16.578466 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:16.578917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:16.579332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:16.717551 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:16.726311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9d315ffb-07c3-4278-9bbc-4b5d7ea66459 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.161189 Aug 24 03:44:16.726889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 413/826] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:16 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:16.961304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:16.961907 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:16.969443 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:16.969837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:16.970547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:16.971310 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:16.971756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:16.972606 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.042020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:17.042803 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:17.056520 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:17.057027 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:17.057465 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.058467 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:17.058960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:17.060031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.226405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:17.244667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:17.246898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:17.248337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-55a82a0b-f197-486a-8bf9-45a456edaa83 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1724 microversion: 2.20 time: 0.291155 Aug 24 03:44:17.249511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 414/827] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:16 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:17.409376 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:17.419982 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0f724b11-ccaf-4c12-b3ec-e70eb0098600 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.382158 Aug 24 03:44:17.420825 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 414/828] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:17 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:17.748198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:17.749142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:17.755979 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:17.756561 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:17.757070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.758006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:17.758581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:17.759413 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:17.999570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:18.011586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-adc41832-8b24-4c00-b2b6-0294d2adaa90 req-5aac914d-73fe-47a0-91d2-c809b2e75f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e834164b-a670-4f2a-8322-0d968d8e6703", "name": "network-vif-deleted", "tag": "0f8767fa-c35d-4362-bf07-a72ca2d4c311"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:18.020609 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4f4f20a3-7233-42cf-87c3-cffdb0da3d01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.277045 Aug 24 03:44:18.021767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 415/829] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:17 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:18.026524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-adc41832-8b24-4c00-b2b6-0294d2adaa90 req-5aac914d-73fe-47a0-91d2-c809b2e75f7e service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.027145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-adc41832-8b24-4c00-b2b6-0294d2adaa90 req-5aac914d-73fe-47a0-91d2-c809b2e75f7e service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.029264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-adc41832-8b24-4c00-b2b6-0294d2adaa90 req-5aac914d-73fe-47a0-91d2-c809b2e75f7e service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.044950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-adc41832-8b24-4c00-b2b6-0294d2adaa90 req-5aac914d-73fe-47a0-91d2-c809b2e75f7e service nova] Creating event network-vif-deleted:0f8767fa-c35d-4362-bf07-a72ca2d4c311 for instance e834164b-a670-4f2a-8322-0d968d8e6703 on hv-cinder-85426 Aug 24 03:44:18.050350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-adc41832-8b24-4c00-b2b6-0294d2adaa90 req-5aac914d-73fe-47a0-91d2-c809b2e75f7e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042265 Aug 24 03:44:18.051744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 415/830] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:18.272016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:18.272518 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:18.278576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.279057 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.279489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.280187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.280841 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.281101 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.362559 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:18.372205 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:18.373759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:18.374932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8de8bfa3-6143-4d05-a9d2-943fb7ee7476 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1656 microversion: 2.20 time: 0.107349 Aug 24 03:44:18.375491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 416/831] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:18 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:18.443366 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:18.444196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:18.450393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.450879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.451315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.452067 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:18.452530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:18.452955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:18.593286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:18.601611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-46539e97-46ab-495c-807f-7b53641e3664 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.162515 Aug 24 03:44:18.602209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 416/832] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:18 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:19.042217 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:19.042845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:19.049612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.050034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.050500 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.051200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.051655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.052109 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.188394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:19.196672 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-92f3659e-a8b7-4f84-a7cf-4a1dde1c4d2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.158374 Aug 24 03:44:19.197245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 417/833] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:19 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:19.398051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:19.398704 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:19.405323 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.405810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.406275 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.407040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.407493 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.407913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.474003 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:19.482366 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:19.483871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:19.489693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6c55134f-6a2b-44f8-8ab8-582ca1fff3cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1367 microversion: 2.20 time: 0.096586 Aug 24 03:44:19.490261 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 417/834] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:19 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:19.623103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:19.623657 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:19.629695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.630176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.630645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.631336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:19.631792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:19.632218 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:19.765245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:19.773387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b5ea8038-b793-4f20-bf84-3dbc07bb7101 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.154239 Aug 24 03:44:19.773946 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 418/835] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:19 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:20.218359 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:20.218975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:20.225553 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.226040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.226515 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.227209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.227670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.228098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.365580 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:20.373340 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-12c59105-d9e9-4357-894b-40d32dfd609a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.158847 Aug 24 03:44:20.373904 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 418/836] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:20 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:20.521936 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:20.522638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:20.529182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.529665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.530104 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.530883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.531337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.531927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.595757 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:20.604130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:20.605688 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:20.606875 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-414f82c8-f52d-492f-99b1-43d237493751 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1367 microversion: 2.20 time: 0.089366 Aug 24 03:44:20.607429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 419/837] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:20 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:20.794561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:20.795158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:20.801626 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.802105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.802565 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.803245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:20.803690 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:20.804105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:20.935760 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:20.944483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5712147a-498a-4c7b-abea-6dd3bf05ef9a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.153694 Aug 24 03:44:20.945062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 419/838] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:20 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:21.393917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:21.394556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:21.396447 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:21.397106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:21.402972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.403459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.403897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.404605 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.405309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.405484 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.546586 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:21.555182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8c3987cd-4a80-44df-8894-a38fd5f95964 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.165166 Aug 24 03:44:21.555759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 420/839] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:21 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:21.629037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:21.629641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:21.631642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=6 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:21.637043 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.637515 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.637941 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.638651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.639096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.639512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.708501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:21.716840 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:21.718364 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:21.719577 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-87998a07-7595-4511-b9af-b41b80bdc81f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1367 microversion: 2.20 time: 0.094481 Aug 24 03:44:21.720141 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 420/840] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:21 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:21.966642 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:21.967161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:21.973986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.974502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.974935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:21.975623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:21.976069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:21.976481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.111903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:22.119662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8df9dfc4-9ec0-46da-9d27-b016f39be45f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.156934 Aug 24 03:44:22.120225 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 421/841] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:21 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:22.576934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:22.577571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:22.584254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.584728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.585160 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.585843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.586469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.586944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.737378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:22.744877 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:22.746076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:22.747439 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-18969c4e-74a0-4d01-8d6a-a346dfea031b tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.174373 Aug 24 03:44:22.748106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 421/842] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:22 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:22.755987 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.756471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.756903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.757597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.758044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.758487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.793669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:22.794286 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:22.794789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:22.795240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lazy-loading 'fault' on Instance uuid e834164b-a670-4f2a-8322-0d968d8e6703 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:22.837818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:22.846802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:22.848861 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:22.850036 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ff030bdf-9716-451c-bf4b-fbdfd81ad2cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 200 len: 1372 microversion: 2.20 time: 0.110148 Aug 24 03:44:22.850623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 422/843] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:22 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:44:23.140995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.141710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:23.148340 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.148826 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.149262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.149958 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.150470 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.150897 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.291665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:23.299411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-85633fec-1ee5-4dc5-8783-f4702a1cf6fd tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.162335 Aug 24 03:44:23.300168 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 422/844] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:23 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:23.771752 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.772379 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:23.779548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.780062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.780525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.781283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.781866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.782503 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.873797 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.874381 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:23.881460 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.881975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.882548 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.883255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:23.883742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:23.884152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:23.899477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] HTTP exception thrown: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Request method failure captured: Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 HTTP/1.1 Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzKLG5UtwjB48qGmmzYtljF01oSiUbW8hGkxXXJdEAlaUHPE4csWu94vh0nlIyiIHeaBvYH9K0KQ2JlhQVGKUXW_-5XdbGy0gpZiUhV0EPm7I3fWsoHa4db7duOPefcrYZd-GW614_pzUZ3GnUO3iMzwtJHJv3uQN_wke5osHDFKQo Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:44:23.901312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 0b294c0072b740cc960bc53e1f806ffc Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:44:23.903065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'e834164b-a670-4f2a-8322-0d968d8e6703'} Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:23.907859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:44:23.909410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:23.911677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Returning 404 to user: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:23.911677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4c852b37-e1fc-4ee0-97d1-aeb58431b7c7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 404 len: 111 microversion: 2.20 time: 0.033700 Aug 24 03:44:23.911677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 423/845] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:23 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:44:23.914142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e518564b-3d45-4583-ac7a-c4831b6c1535 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '.version_select at 0x7f077c1c09d0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:23.929084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:23.936114 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e518564b-3d45-4583-ac7a-c4831b6c1535 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971087163" status: 204 len: 0 microversion: 2.20 time: 0.027035 Aug 24 03:44:23.936720 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 424/846] 10.222.0.91 () {60 vars in 1262 bytes} [Wed Aug 24 03:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971087163 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:44:23.937869 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-049492af-cbf0-4b99-b580-c262b97dc236 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1569 microversion: 2.1 time: 0.171255 Aug 24 03:44:23.938718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 423/847] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:23 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:24.020512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:24.021146 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:24.027322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.027810 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.028251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.028984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.029395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.029888 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.061727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127260) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:44:24.156848 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c6449ae6-b783-448b-b517-a3833e4980c2 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "POST /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938/action" status: 202 len: 0 microversion: 2.1 time: 0.139764 Aug 24 03:44:24.162710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 425/848] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:44:24 2022] POST /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:24.167059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:24.167670 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:24.176798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.177674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.178374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.179273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.180159 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.180982 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.321301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:24.321915 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:24.328678 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.329195 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.329603 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.330432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.330836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.331349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.501410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:24.503163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:24.510607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-adc2fc8c-f40b-442a-a30b-1e1689b53954 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1517 microversion: 2.1 time: 0.347190 Aug 24 03:44:24.511623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 424/849] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:24 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:24.513635 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c0d5c359-8512-4b9e-a89a-9cab809f45b1 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.196420 Aug 24 03:44:24.514992 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 426/850] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:24 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:24.809503 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-24f787da-10d4-4059-be55-8d49cc0e759f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'create', calling method: .version_select at 0x7f077f849940>, body: {"keypair": {"name": "tempest-keypair-1621831925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuJuI6B776pmsKh6tyxKYADkWo/09NKjAmmIadprbbGFOlbzMYjpnySoiJ3yJoOxATZQOWEdh9FbE4o3O1sHrIZ7qXn3/1kszf3Lm6Jg7rj/MNmDajEZOav+2JM0HHYhw=="}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:24.828229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-24f787da-10d4-4059-be55-8d49cc0e759f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Getting quotas for project 6f0007a8402e4889bc8ed99a507036e4. Resources: {'key_pairs'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:24.832599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-24f787da-10d4-4059-be55-8d49cc0e759f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Getting quotas for user 0b294c0072b740cc960bc53e1f806ffc and project 6f0007a8402e4889bc8ed99a507036e4. Resources: {'key_pairs'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:24.855321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-24f787da-10d4-4059-be55-8d49cc0e759f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051485 Aug 24 03:44:24.855922 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 425/851] 10.222.0.91 () {62 vars in 1200 bytes} [Wed Aug 24 03:44:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:44:24.968171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-e196a30f-54fe-4552-ad83-6d5bd7f2263e req-d297186c-aa08-4f3f-89da-21240fc46602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e94e4298-9115-41cc-9220-252b7e0781d1", "name": "network-vif-plugged", "status": "completed", "tag": "da87d65f-39b6-4d02-8533-ddf918ad0857"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:24.985590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e196a30f-54fe-4552-ad83-6d5bd7f2263e req-d297186c-aa08-4f3f-89da-21240fc46602 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:24.986130 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e196a30f-54fe-4552-ad83-6d5bd7f2263e req-d297186c-aa08-4f3f-89da-21240fc46602 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:24.986610 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e196a30f-54fe-4552-ad83-6d5bd7f2263e req-d297186c-aa08-4f3f-89da-21240fc46602 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:24.999871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-e196a30f-54fe-4552-ad83-6d5bd7f2263e req-d297186c-aa08-4f3f-89da-21240fc46602 service nova] Creating event network-vif-plugged:da87d65f-39b6-4d02-8533-ddf918ad0857 for instance e94e4298-9115-41cc-9220-252b7e0781d1 on hv-cinder-85426 Aug 24 03:44:25.006115 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-e196a30f-54fe-4552-ad83-6d5bd7f2263e req-d297186c-aa08-4f3f-89da-21240fc46602 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042095 Aug 24 03:44:25.007799 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 427/852] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:25.543389 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:25.544127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:25.544423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:25.545193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:25.552665 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.553240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.553743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.554714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.555076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.555669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.557793 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.558712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.559166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.560284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:25.560756 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:25.561187 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:25.567283 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:25.708159 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:25.716292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-40ce7851-7cb0-4768-a364-c343a66ba7a5 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1519 microversion: 2.1 time: 0.176541 Aug 24 03:44:25.716872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 428/853] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:25 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:25.779014 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:25.789779 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-538369c2-88af-4cad-851d-199739748bd4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.250056 Aug 24 03:44:25.790637 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 426/854] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:25 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:26.437405 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-651585537", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "040cf074-35e6-4c0d-8efa-af5dafe3fbd5"}], "security_groups": [{"name": "tempest-securitygroup--2029003838"}], "key_name": "tempest-keypair-1621831925", "user_data": "}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:26.556568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] validate_networks() for [('040cf074-35e6-4c0d-8efa-af5dafe3fbd5', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:44:26.738979 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:26.739774 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:26.746128 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.746643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.747077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.747777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.748230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.748660 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.887018 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:26.891097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:26.896941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a7661414-c5ac-49b8-954d-bdc1408e8fb3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1519 microversion: 2.1 time: 0.162032 Aug 24 03:44:26.897523 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 427/855] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:26 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:26.902224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:26.902821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:26.909147 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.909860 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.911067 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:26.912005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:26.912401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:26.912826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.014821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:44:27.015242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:44:27.015716 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:44:27.016124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:44:27.016538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:44:27.026081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.026589 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.027028 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.028041 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.028215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.028823 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.046957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Getting quotas for project 6f0007a8402e4889bc8ed99a507036e4. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:44:27.051086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Getting quotas for user 0b294c0072b740cc960bc53e1f806ffc and project 6f0007a8402e4889bc8ed99a507036e4. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:44:27.054861 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:27.060645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:27.067044 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:44:27.070671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:44:27.072596 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-96277cfe-247d-4654-8ef1-5eadba420c8d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1366 microversion: 2.1 time: 0.174052 Aug 24 03:44:27.084337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 428/856] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:26 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:27.084337 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-a14a06f4-dac3-4344-b972-a82a856bc063 req-df8e63e4-08ae-4816-bb12-e678d3c2cec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6e4c30-7ab0-446f-8f76-078a95397938", "name": "network-vif-unplugged", "status": "completed", "tag": "c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:27.100429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a14a06f4-dac3-4344-b972-a82a856bc063 req-df8e63e4-08ae-4816-bb12-e678d3c2cec2 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.100885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a14a06f4-dac3-4344-b972-a82a856bc063 req-df8e63e4-08ae-4816-bb12-e678d3c2cec2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.101326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a14a06f4-dac3-4344-b972-a82a856bc063 req-df8e63e4-08ae-4816-bb12-e678d3c2cec2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.116499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.compute.server_external_events [req-a14a06f4-dac3-4344-b972-a82a856bc063 req-df8e63e4-08ae-4816-bb12-e678d3c2cec2 service nova] Unable to find a host for instance dc6e4c30-7ab0-446f-8f76-078a95397938. Dropping event network-vif-unplugged {{(pid=127259) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:44:27.117376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-a14a06f4-dac3-4344-b972-a82a856bc063 req-df8e63e4-08ae-4816-bb12-e678d3c2cec2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042643 Aug 24 03:44:27.117967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 429/857] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 03:44:27.128391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2e4b766f-c86d-4f3f-aee7-ed0db278cd1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.697284 Aug 24 03:44:27.129509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 429/858] 10.222.0.91 () {62 vars in 1188 bytes} [Wed Aug 24 03:44:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:44:27.141005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f66063df-6fbc-449d-9bea-fe53af91bb10 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:27.142223 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f66063df-6fbc-449d-9bea-fe53af91bb10 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:27.202816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f66063df-6fbc-449d-9bea-fe53af91bb10 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:27.211650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f66063df-6fbc-449d-9bea-fe53af91bb10 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:27.213200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f66063df-6fbc-449d-9bea-fe53af91bb10 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:27.214344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f66063df-6fbc-449d-9bea-fe53af91bb10 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1281 microversion: 2.20 time: 0.077548 Aug 24 03:44:27.214902 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 430/859] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:27 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:27.925280 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:27.926563 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:27.935567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.936059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.936507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:27.937212 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:27.937666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:27.938086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.073025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.080847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7c07b74a-71a5-4dd3-bb66-0a8807b50e55 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.163404 Aug 24 03:44:28.081411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 430/860] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:27 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:28.099588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:28.100195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:28.107193 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.107679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.108116 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.108966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.109272 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.109698 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.237503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:28.239132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:28.244020 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.245590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.246082 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.246636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.247385 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.247855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.248461 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.253641 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c2faa3c0-9c98-4a23-9f15-db4b4d1e3082 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1556 microversion: 2.1 time: 0.158347 Aug 24 03:44:28.254727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 431/861] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:28 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:28.275130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:28.275625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:28.281735 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.282278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.282719 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.283449 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:28.283901 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:28.284327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:28.313821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.324143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.325928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:28.327286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1546ba9a-9580-4069-b91a-cab064a91cae tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1277 microversion: 2.20 time: 0.094037 Aug 24 03:44:28.328325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 431/862] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:28 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:44:28.378935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a5ac3475-7985-4637-b335-834983b4e1b0 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107585 Aug 24 03:44:28.379532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 432/863] 10.222.0.91 () {58 vars in 1275 bytes} [Wed Aug 24 03:44:28 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:29.101491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:29.102133 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:29.108915 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.109759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.109878 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.110544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.111010 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.111424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.338227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:29.351451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:29.352028 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-367c33e0-31a5-4be6-9129-89f1430831ee tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.253551 Aug 24 03:44:29.352248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 432/864] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:29 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:29.353369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:29.367360 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.368763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.369284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.371213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:29.371213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:29.371468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:29.474136 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:29.485083 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:29.487541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:29.488764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-36b26c97-883d-4583-b037-8b77fc10db50 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1341 microversion: 2.20 time: 0.143737 Aug 24 03:44:29.489341 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 433/865] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:29 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1341 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:29.996906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-61c75328-f730-4544-96a1-34e10cc824cf req-99d5076a-8c88-42cf-938e-10bc1f466498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e94e4298-9115-41cc-9220-252b7e0781d1", "tag": "da87d65f-39b6-4d02-8533-ddf918ad0857"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:30.007252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-61c75328-f730-4544-96a1-34e10cc824cf req-99d5076a-8c88-42cf-938e-10bc1f466498 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.008027 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-61c75328-f730-4544-96a1-34e10cc824cf req-99d5076a-8c88-42cf-938e-10bc1f466498 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.008717 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-61c75328-f730-4544-96a1-34e10cc824cf req-99d5076a-8c88-42cf-938e-10bc1f466498 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.022479 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-61c75328-f730-4544-96a1-34e10cc824cf req-99d5076a-8c88-42cf-938e-10bc1f466498 service nova] Creating event network-changed:da87d65f-39b6-4d02-8533-ddf918ad0857 for instance e94e4298-9115-41cc-9220-252b7e0781d1 on hv-cinder-85426 Aug 24 03:44:30.028100 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-61c75328-f730-4544-96a1-34e10cc824cf req-99d5076a-8c88-42cf-938e-10bc1f466498 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035010 Aug 24 03:44:30.029030 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 433/866] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:30.380243 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:30.382823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:30.391851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.392901 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.393520 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.394459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.396029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.396870 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.517230 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:30.518630 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:30.527251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.528042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.528636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.529523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:30.530143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:30.530764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:30.586892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:30.602394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b71e9eb6-1a22-4fe2-b72d-a26506c91260 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.230963 Aug 24 03:44:30.603656 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 434/867] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:30 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:30.685335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:30.693883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:30.695417 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:30.696606 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-18d6731d-49df-472a-a365-9f0464aa0b4a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.185273 Aug 24 03:44:30.697381 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 434/868] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:30 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:31.630262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:31.631537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:31.641921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.642769 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.643297 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.644895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.645569 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.647053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.724652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:31.725992 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:31.734996 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.735772 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.736389 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.737123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:31.737883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:31.738220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:31.895678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:31.905892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8c9e1e33-0cbf-4a3e-9f60-e4edda9279f7 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.282647 Aug 24 03:44:31.922803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 435/869] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:31 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:32.072330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-6e48bbcd-b230-4bcb-961d-9ced27bcd6e9 req-5c17efe5-801a-4554-9130-c5b78c0672d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "684ce0ff-fd32-480d-ba7c-07d564e2a702", "tag": "6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:32.086412 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-6e48bbcd-b230-4bcb-961d-9ced27bcd6e9 req-5c17efe5-801a-4554-9130-c5b78c0672d9 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.087112 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-6e48bbcd-b230-4bcb-961d-9ced27bcd6e9 req-5c17efe5-801a-4554-9130-c5b78c0672d9 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.087540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-6e48bbcd-b230-4bcb-961d-9ced27bcd6e9 req-5c17efe5-801a-4554-9130-c5b78c0672d9 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.107376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-6e48bbcd-b230-4bcb-961d-9ced27bcd6e9 req-5c17efe5-801a-4554-9130-c5b78c0672d9 service nova] Creating event network-changed:6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf for instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 on hv-cinder-85426 Aug 24 03:44:32.114321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-6e48bbcd-b230-4bcb-961d-9ced27bcd6e9 req-5c17efe5-801a-4554-9130-c5b78c0672d9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049187 Aug 24 03:44:32.115706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 436/870] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:32.125282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:32.134565 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:32.136398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:32.137824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7e3e3ab7-1a0d-4b52-81cd-06464c66c296 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.421735 Aug 24 03:44:32.138667 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 435/871] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:31 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:32.940312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:32.941006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:32.947428 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.947910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.948343 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:32.949034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:32.949490 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:32.949918 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.083798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:33.091486 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-276b6de2-501b-44d9-9853-ce9fe5da2602 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.155902 Aug 24 03:44:33.092053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 437/872] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:32 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:33.162483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:33.163087 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:33.169369 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:33.169851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:33.170301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.170981 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:33.171425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:33.171843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:33.304488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:33.313166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:33.314679 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:33.315779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e3636350-4bd7-42bd-8e3c-6b125d8d3d2c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.158007 Aug 24 03:44:33.316335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 436/873] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:33 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:34.112876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:34.113493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:34.115935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:34.121216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.121697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.122138 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.122867 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.123324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.123751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.254933 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:34.262745 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b16ccb04-0859-4a09-9ff8-8dce685ef7d1 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.153722 Aug 24 03:44:34.263309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 438/874] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:34 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:34.338984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:34.339593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:34.345973 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.346483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.346925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.347605 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:34.348056 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:34.348478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:34.474692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:34.482697 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:34.484182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:34.485269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bcc83af1-2b5d-4a1f-b4c2-19a715034f7a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.150107 Aug 24 03:44:34.485822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 437/875] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:34 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:35.284652 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:35.285879 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:35.292355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.292885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.293377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.294072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.294553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.294972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.508282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:35.508923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:35.509539 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:35.515520 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.516001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.516127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5aa13833-3b78-4077-b291-624dee0c8be3 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.235269 Aug 24 03:44:35.516436 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.516967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 439/876] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:35 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:35.524553 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:35.525078 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:35.525554 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:35.664780 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:35.673222 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:35.675104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:35.676256 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5e14dce5-c578-40e7-8ebd-2f1c8c457ec3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.171803 Aug 24 03:44:35.676817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 438/877] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:35 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:44:36.542054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:36.542703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:36.551886 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.552827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.553614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.554946 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.555858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.556678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.694011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:36.699896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:36.700499 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:36.701918 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3d70040a-a35f-403f-83df-9194d11cc734 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.163697 Aug 24 03:44:36.702511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 440/878] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:36 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:36.707214 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.708232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.708662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.709341 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:36.709789 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:36.710597 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:36.841033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:36.849337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:36.850972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:36.852167 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-56fa03ac-9c60-403d-8e09-fd2216795fe9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.156100 Aug 24 03:44:36.866209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 439/879] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:36 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:44:37.724055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:37.724693 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:37.726753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:37.732879 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:37.733364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:37.733797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:37.734531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:37.734986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:37.735407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:37.875986 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:37.876727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:37.878548 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:37.878862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:37.879299 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=6 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:37.885482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:37.885992 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:37.886452 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:37.887146 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:37.887533 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5cea5de4-ee50-4eb2-a250-8d4a75e9cb01 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.167910 Aug 24 03:44:37.887657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:37.888013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:37.888112 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 441/880] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:37 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:38.025834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:38.034144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:38.035710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:38.036809 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0d210123-c68a-4861-b9f2-3d6849f28c68 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.164917 Aug 24 03:44:38.037363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 440/881] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:37 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:44:38.908680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:38.909285 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:38.915734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:38.916213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:38.916648 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:38.917332 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:38.917863 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:38.918311 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.058741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:39.067718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0320f048-7e5d-43e0-9bce-33b44f9f5163 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.162929 Aug 24 03:44:39.070414 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 442/882] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:38 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:39.070567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:39.070567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:39.075913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.076400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.077017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.077726 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.078175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.078781 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.122088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-a6f64a81-c466-47fc-ae1b-a24aa463796d req-ba9194e8-e191-4ad1-8c63-cf26b0e7ff31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684ce0ff-fd32-480d-ba7c-07d564e2a702", "name": "network-vif-plugged", "status": "completed", "tag": "6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:39.133312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a6f64a81-c466-47fc-ae1b-a24aa463796d req-ba9194e8-e191-4ad1-8c63-cf26b0e7ff31 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:39.133772 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a6f64a81-c466-47fc-ae1b-a24aa463796d req-ba9194e8-e191-4ad1-8c63-cf26b0e7ff31 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:39.135613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a6f64a81-c466-47fc-ae1b-a24aa463796d req-ba9194e8-e191-4ad1-8c63-cf26b0e7ff31 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:39.152091 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-a6f64a81-c466-47fc-ae1b-a24aa463796d req-ba9194e8-e191-4ad1-8c63-cf26b0e7ff31 service nova] Creating event network-vif-plugged:6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf for instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 on hv-cinder-85426 Aug 24 03:44:39.158933 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-a6f64a81-c466-47fc-ae1b-a24aa463796d req-ba9194e8-e191-4ad1-8c63-cf26b0e7ff31 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041225 Aug 24 03:44:39.159816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 443/883] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:44:39.231423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:39.240305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:39.241816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:39.244379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-be0ee9d2-59ec-498a-900d-5517b7fa010b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.182850 Aug 24 03:44:39.244981 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 441/884] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:39 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:40.090852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:40.091554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:40.099693 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.100589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.101362 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.102658 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.103488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.104269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.241852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:40.250925 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2fc5dab0-86ef-4b51-ba60-ebf816734c61 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.164800 Aug 24 03:44:40.251496 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 444/885] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:40 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:40.267976 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:40.268626 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:40.275266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.275748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.276194 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.276891 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:40.277344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:40.277771 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:40.415834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:40.424032 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:40.425522 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:40.427268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c509bbe6-5bf8-403e-b6e0-613a89123aa6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1407 microversion: 2.20 time: 0.163295 Aug 24 03:44:40.427824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 442/886] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:40 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:44:41.273013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:41.273547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:41.280040 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.280525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.280959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.281661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.282348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.282774 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.449248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:41.449862 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:41.458582 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.459479 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.460059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.460356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:41.461231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.462052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.462899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.468153 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1a314112-2685-4fbe-ae8b-ef41f57978b6 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.199054 Aug 24 03:44:41.468698 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 445/887] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:41 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:41.633880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:41.648902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:41.650460 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:41.651631 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-520b3e87-d219-4260-ab76-90d61c5af23a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1599 microversion: 2.20 time: 0.206233 Aug 24 03:44:41.652190 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 443/888] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:44:41 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:44:41.677620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:41.678304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:41.686542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.687154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.687591 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.688434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:41.689069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:41.689491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:41.778410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-21c96a1a-5d3c-4daf-a2bf-e169c5b0afd1 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106030 Aug 24 03:44:41.779329 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 446/889] 10.222.0.91 () {60 vars in 1316 bytes} [Wed Aug 24 03:44:41 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:44:42.491124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:42.491947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:42.499336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.500149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.500614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.501713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:42.502360 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:42.502977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:42.651110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:42.659769 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c7613d23-ed3f-4169-957e-f2ce1cab9707 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.174283 Aug 24 03:44:42.661389 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 444/890] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:42 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:43.090426 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-57e4a40c-e2de-4a55-b5f7-94adb1596f49 req-121d6292-4fcb-4d54-abcd-549b14949948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "684ce0ff-fd32-480d-ba7c-07d564e2a702", "tag": "6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:43.105092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-57e4a40c-e2de-4a55-b5f7-94adb1596f49 req-121d6292-4fcb-4d54-abcd-549b14949948 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:43.105804 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-57e4a40c-e2de-4a55-b5f7-94adb1596f49 req-121d6292-4fcb-4d54-abcd-549b14949948 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:43.106678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-57e4a40c-e2de-4a55-b5f7-94adb1596f49 req-121d6292-4fcb-4d54-abcd-549b14949948 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:43.120593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-57e4a40c-e2de-4a55-b5f7-94adb1596f49 req-121d6292-4fcb-4d54-abcd-549b14949948 service nova] Creating event network-changed:6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf for instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 on hv-cinder-85426 Aug 24 03:44:43.126581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-57e4a40c-e2de-4a55-b5f7-94adb1596f49 req-121d6292-4fcb-4d54-abcd-549b14949948 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040211 Aug 24 03:44:43.127533 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 447/891] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:43.550246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-e8721969-d8ee-4ad4-b8c0-5cc9b1ef8fa1 req-73401890-7aed-457c-8e00-e3bdf7c42bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6e4c30-7ab0-446f-8f76-078a95397938", "name": "network-vif-plugged", "status": "completed", "tag": "c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:43.571372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e8721969-d8ee-4ad4-b8c0-5cc9b1ef8fa1 req-73401890-7aed-457c-8e00-e3bdf7c42bc3 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:43.573770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e8721969-d8ee-4ad4-b8c0-5cc9b1ef8fa1 req-73401890-7aed-457c-8e00-e3bdf7c42bc3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:43.574828 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e8721969-d8ee-4ad4-b8c0-5cc9b1ef8fa1 req-73401890-7aed-457c-8e00-e3bdf7c42bc3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:43.589176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-e8721969-d8ee-4ad4-b8c0-5cc9b1ef8fa1 req-73401890-7aed-457c-8e00-e3bdf7c42bc3 service nova] Creating event network-vif-plugged:c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27 for instance dc6e4c30-7ab0-446f-8f76-078a95397938 on hv-cinder-85426 Aug 24 03:44:43.596748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-e8721969-d8ee-4ad4-b8c0-5cc9b1ef8fa1 req-73401890-7aed-457c-8e00-e3bdf7c42bc3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051051 Aug 24 03:44:43.598147 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 445/892] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:43.687203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:43.688052 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:43.698475 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:43.699327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:43.699974 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:43.700939 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:43.701594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:43.702260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:43.965312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:43.969135 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=100 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:43.975126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-eeb972de-ef2d-44fa-8424-62b42325b03a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.295667 Aug 24 03:44:43.975713 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 448/893] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:43 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:44.958326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-104341195"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:44.958960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:44.965720 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.966234 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.966642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.967335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:44.967796 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:44.968210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:44.996941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:44.997584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:45.004699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:45.005183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:45.005623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:45.006349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:45.006812 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:45.007235 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:45.125992 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.network.security_group_api [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Removing security group b8f2f514-2672-45f5-b000-6c34ee3a833d from port 09ae71df-f7d0-490a-a020-01bb30ef1264 Aug 24 03:44:45.160985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:45.170554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7860d753-729d-4187-aee6-123bc1814111 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1575 microversion: 2.1 time: 0.177353 Aug 24 03:44:45.171132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 449/894] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:44 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:45.487916 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-03db0cf2-30f4-48ba-b63c-6d39b8f1ae31 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "POST /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/action" status: 202 len: 0 microversion: 2.1 time: 0.534016 Aug 24 03:44:45.489186 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 446/895] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:44:44 2022] POST /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:45.497789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-2d7eb7a8-d463-418b-9dec-66cf89dab7a8 req-6ae3a688-9f2c-45b9-8d00-efbb7b7fcf61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719d0058-3b46-49ca-88e3-96546c996278", "tag": "09ae71df-f7d0-490a-a020-01bb30ef1264"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:45.509016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-2d7eb7a8-d463-418b-9dec-66cf89dab7a8 req-6ae3a688-9f2c-45b9-8d00-efbb7b7fcf61 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:45.509016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-2d7eb7a8-d463-418b-9dec-66cf89dab7a8 req-6ae3a688-9f2c-45b9-8d00-efbb7b7fcf61 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:45.509016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-2d7eb7a8-d463-418b-9dec-66cf89dab7a8 req-6ae3a688-9f2c-45b9-8d00-efbb7b7fcf61 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:45.522284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-2d7eb7a8-d463-418b-9dec-66cf89dab7a8 req-6ae3a688-9f2c-45b9-8d00-efbb7b7fcf61 service nova] Creating event network-changed:09ae71df-f7d0-490a-a020-01bb30ef1264 for instance 719d0058-3b46-49ca-88e3-96546c996278 on hv-cinder-85426 Aug 24 03:44:45.528914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-2d7eb7a8-d463-418b-9dec-66cf89dab7a8 req-6ae3a688-9f2c-45b9-8d00-efbb7b7fcf61 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 Aug 24 03:44:45.529764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 450/896] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:46.206500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:46.208087 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:46.216443 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.216926 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.217451 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.218072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.218570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.219000 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.222057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:46.391378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:46.401300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1a8726c6-5fa8-496f-b864-892ea960ab5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1562 microversion: 2.1 time: 0.202949 Aug 24 03:44:46.401889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 447/897] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:46 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1562 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:46.748333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:46.750299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:46.760835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-a81068a9-3abd-4c3b-907f-4889ca576ad0 req-93cbcfd7-9c14-4e7a-ab23-2fba02051ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719d0058-3b46-49ca-88e3-96546c996278", "tag": "09ae71df-f7d0-490a-a020-01bb30ef1264"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:46.772140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.773197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.773723 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.774599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.775314 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.775988 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.779805 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-a81068a9-3abd-4c3b-907f-4889ca576ad0 req-93cbcfd7-9c14-4e7a-ab23-2fba02051ba3 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:46.781750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-a81068a9-3abd-4c3b-907f-4889ca576ad0 req-93cbcfd7-9c14-4e7a-ab23-2fba02051ba3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:46.782217 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-a81068a9-3abd-4c3b-907f-4889ca576ad0 req-93cbcfd7-9c14-4e7a-ab23-2fba02051ba3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:46.798636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-a81068a9-3abd-4c3b-907f-4889ca576ad0 req-93cbcfd7-9c14-4e7a-ab23-2fba02051ba3 service nova] Creating event network-changed:09ae71df-f7d0-490a-a020-01bb30ef1264 for instance 719d0058-3b46-49ca-88e3-96546c996278 on hv-cinder-85426 Aug 24 03:44:46.807788 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-a81068a9-3abd-4c3b-907f-4889ca576ad0 req-93cbcfd7-9c14-4e7a-ab23-2fba02051ba3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050703 Aug 24 03:44:46.808951 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 448/898] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:46.894401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lazy-loading 'services' on Instance uuid 719d0058-3b46-49ca-88e3-96546c996278 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:44:47.015140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8f5abe8c-a1c2-49e8-8f4d-809c808e14b2 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "DELETE /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments/1aedc236-9eee-4158-bccd-bcdaa2f4dae4" status: 202 len: 0 microversion: 2.1 time: 0.271653 Aug 24 03:44:47.016227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 451/899] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:44:46 2022] DELETE /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments/1aedc236-9eee-4158-bccd-bcdaa2f4dae4 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:44:47.029211 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:47.031618 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:47.038336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.039118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.039737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.040636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:47.041349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:47.041945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:47.076377 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d1262b31-c149-4ccc-b0bd-ff2e2949e286 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052722 Aug 24 03:44:47.077273 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 449/900] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:44:47 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:48.100683 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:48.103883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:48.121059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:48.121714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:48.122434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:48.123432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:48.124106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:48.124739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:48.164092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d878bd44-73ea-4ee0-b1c2-3fd66b3144e7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073542 Aug 24 03:44:48.165182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 452/901] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:44:48 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:49.179823 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:49.181971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:49.189226 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.189733 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.190176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.190917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.191379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.191825 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.221689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3fdff82a-2a2b-4dc1-9d68-6c93a8b76ecc tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047573 Aug 24 03:44:49.222283 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 450/902] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:44:49 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:44:49.236524 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:49.237102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:49.244186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.244659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.245084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.245771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:49.246241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:49.246659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:49.324704 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] HTTP exception thrown: Instance 719d0058-3b46-49ca-88e3-96546c996278 is not attached to volume 1aedc236-9eee-4158-bccd-bcdaa2f4dae4 Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Request method failure captured: Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments/1aedc236-9eee-4158-bccd-bcdaa2f4dae4 HTTP/1.1 Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZ1-jF0miQuAMoX6qcJyARZxPW4o4pJ2iZ7A4-oxMfBNYLAiCpId5n3LZScV8cJYvL8oGvUIIMKbllYm8pgiUn-MQ5skvsjyM13wMBT2ZeBs5Eh8TRrR5V90opCzrU1etvBLCw990ATSnmliQLpBa_A8kZAhUxsO43m-zE9uXTgq1Gk Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 0fe6a4ca8c984b2aa4df4c47b4c1d03b Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-TestMinimumBasicScenario-1309017 Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:44:49.330479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_0fe6a4ca8c984b2aa4df4c47b4c1d03b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0fe6a4ca8c984b2aa4df4c47b4c1d03b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/0fe6a4ca8c984b2aa4df4c47b4c1d03b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0fe6a4ca8c984b2aa4df4c47b4c1d03b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-TestMinimumBasicScenario-1309017 Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 0fe6a4ca8c984b2aa4df4c47b4c1d03b Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1309017 Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-TestMinimumBasicScenario-1309017-project Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b9f929b986e645109db65651c8ff1502 Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-TestMinimumBasicScenario-1309017-project Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:44:49.333836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 719d0058-3b46-49ca-88e3-96546c996278 is not attached to volume 1aedc236-9eee-4158-bccd-bcdaa2f4dae4 Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'server_id': '719d0058-3b46-49ca-88e3-96546c996278', 'id': '1aedc236-9eee-4158-bccd-bcdaa2f4dae4'} Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1aedc236-9eee-4158-bccd-bcdaa2f4dae4. Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:49.335349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719d0058-3b46-49ca-88e3-96546c996278 is not attached to volume 1aedc236-9eee-4158-bccd-bcdaa2f4dae4 Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719d0058-3b46-49ca-88e3-96546c996278 is not attached to volume 1aedc236-9eee-4158-bccd-bcdaa2f4dae4 Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:44:49.337365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Returning 404 to user: Instance 719d0058-3b46-49ca-88e3-96546c996278 is not attached to volume 1aedc236-9eee-4158-bccd-bcdaa2f4dae4 {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:49.338811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-63223ee1-06b6-46aa-8aa6-4b2675b584f6 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "DELETE /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments/1aedc236-9eee-4158-bccd-bcdaa2f4dae4" status: 404 len: 154 microversion: 2.1 time: 0.099423 Aug 24 03:44:49.338811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 453/903] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:44:49 2022] DELETE /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278/os-volume_attachments/1aedc236-9eee-4158-bccd-bcdaa2f4dae4 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:44:50.663582 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:50.664166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:50.670674 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:50.671153 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:50.671585 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:50.672495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:50.672941 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:50.673356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:50.704314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:44:50.796798 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-77fc46a7-299c-447c-b5bf-7ae20fd3fdc3 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "DELETE /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 204 len: 0 microversion: 2.1 time: 0.138200 Aug 24 03:44:50.797437 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 451/904] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:44:50 2022] DELETE /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:44:50.812367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:50.813000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:50.820459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:50.820950 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:50.821394 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:50.822110 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:50.822607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:50.823028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:50.979211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:50.991405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3d0d0a5c-8177-41f8-b9d5-587407d363c5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1554 microversion: 2.1 time: 0.187659 Aug 24 03:44:50.992087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 454/905] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:50 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:52.013362 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:52.014073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:52.021531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:52.022040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:52.022512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:52.023215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:52.023671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:52.024098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:52.168997 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:52.181145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-935c839b-f83d-439e-a079-b645103afdd5 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1554 microversion: 2.1 time: 0.172081 Aug 24 03:44:52.181725 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 452/906] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:52 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:44:53.203325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:53.203955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:53.211083 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.211558 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.211990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.212675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:53.213119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:53.213535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:53.355612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:53.367062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c4a9e37f-3589-47ac-b521-7852415b6ca7 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1554 microversion: 2.1 time: 0.167525 Aug 24 03:44:53.367588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 455/907] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:53 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:54.315262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-b53fb5fb-1984-4773-8a98-83dca2cec7cf req-350718ea-82aa-437e-9439-05802981b6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719d0058-3b46-49ca-88e3-96546c996278", "name": "network-vif-deleted", "tag": "09ae71df-f7d0-490a-a020-01bb30ef1264"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:44:54.326970 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-b53fb5fb-1984-4773-8a98-83dca2cec7cf req-350718ea-82aa-437e-9439-05802981b6fc service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.327573 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-b53fb5fb-1984-4773-8a98-83dca2cec7cf req-350718ea-82aa-437e-9439-05802981b6fc service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.328008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-b53fb5fb-1984-4773-8a98-83dca2cec7cf req-350718ea-82aa-437e-9439-05802981b6fc service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.341035 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-b53fb5fb-1984-4773-8a98-83dca2cec7cf req-350718ea-82aa-437e-9439-05802981b6fc service nova] Creating event network-vif-deleted:09ae71df-f7d0-490a-a020-01bb30ef1264 for instance 719d0058-3b46-49ca-88e3-96546c996278 on hv-cinder-85426 Aug 24 03:44:54.346623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-b53fb5fb-1984-4773-8a98-83dca2cec7cf req-350718ea-82aa-437e-9439-05802981b6fc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035186 Aug 24 03:44:54.348011 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 453/908] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:44:54.389691 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:54.392162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:54.399347 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.399347 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.399805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.400509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:54.400969 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:54.401393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:54.478299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f929b986e645109db65651c8ff1502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe6a4ca8c984b2aa4df4c47b4c1d03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:44:54.488965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b933326b-bd56-47dd-8c8e-29a28749d452 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 200 len: 1343 microversion: 2.1 time: 0.104425 Aug 24 03:44:54.489952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 456/909] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:54 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 1343 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:44:55.515344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:55.516592 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] [instance: 719d0058-3b46-49ca-88e3-96546c996278] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:44:55.525387 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:55.525925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:55.526462 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:55.527243 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:44:55.527702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:44:55.528130 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:44:55.547103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] HTTP exception thrown: Instance 719d0058-3b46-49ca-88e3-96546c996278 could not be found. Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Request method failure captured: Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 HTTP/1.1 Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ1-jF0miQuAMoX6qcJyARZxPW4o4pJ2iZ7A4-oxMfBNYLAiCpId5n3LZScV8cJYvL8oGvUIIMKbllYm8pgiUn-MQ5skvsjyM13wMBT2ZeBs5Eh8TRrR5V90opCzrU1etvBLCw990ATSnmliQLpBa_A8kZAhUxsO43m-zE9uXTgq1Gk Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 0fe6a4ca8c984b2aa4df4c47b4c1d03b Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-TestMinimumBasicScenario-1309017 Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:44:55.548730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_0fe6a4ca8c984b2aa4df4c47b4c1d03b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0fe6a4ca8c984b2aa4df4c47b4c1d03b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/0fe6a4ca8c984b2aa4df4c47b4c1d03b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/0fe6a4ca8c984b2aa4df4c47b4c1d03b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-TestMinimumBasicScenario-1309017 Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 0fe6a4ca8c984b2aa4df4c47b4c1d03b Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1309017 Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-TestMinimumBasicScenario-1309017-project Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: b9f929b986e645109db65651c8ff1502 Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-TestMinimumBasicScenario-1309017-project Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 719d0058-3b46-49ca-88e3-96546c996278 could not be found. Aug 24 03:44:55.551413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '719d0058-3b46-49ca-88e3-96546c996278'} Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 719d0058-3b46-49ca-88e3-96546c996278 could not be found. Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:44:55.552906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719d0058-3b46-49ca-88e3-96546c996278 could not be found. Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719d0058-3b46-49ca-88e3-96546c996278 could not be found. Aug 24 03:44:55.555495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:44:55.557905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Returning 404 to user: Instance 719d0058-3b46-49ca-88e3-96546c996278 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:44:55.557905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-76a7a2bd-038c-4ba9-a5b4-8d0bc809ee53 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278" status: 404 len: 111 microversion: 2.1 time: 0.042136 Aug 24 03:44:55.557905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 454/910] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:44:55 2022] GET /compute/v2.1/servers/719d0058-3b46-49ca-88e3-96546c996278 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:44:55.561617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-23394a8a-d827-4585-b147-186811961430 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] Calling method '.version_select at 0x7f077f818430>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:44:55.581045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-23394a8a-d827-4585-b147-186811961430 tempest-TestMinimumBasicScenario-1309017 tempest-TestMinimumBasicScenario-1309017-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1570057530" status: 202 len: 0 microversion: 2.1 time: 0.024373 Aug 24 03:44:55.581622 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 457/911] 10.222.0.91 () {58 vars in 1272 bytes} [Wed Aug 24 03:44:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1570057530 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:45:11.251883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:11.252475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:11.255688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:11.256357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:11.262921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:11.263406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:11.263942 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:11.264645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:11.265328 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:11.265947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:11.403639 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.objects.instance [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lazy-loading 'services' on Instance uuid 6560bb95-66b1-4d4f-a87b-4bc63cd92674 {{(pid=127260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:45:11.526507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8f433a78-9397-4c8b-a750-6456294ef612 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "DELETE /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments/227e4dec-7478-4be2-9118-3bc2fd5583ca" status: 202 len: 0 microversion: 2.1 time: 0.278625 Aug 24 03:45:11.527295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 455/912] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:45:11 2022] DELETE /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments/227e4dec-7478-4be2-9118-3bc2fd5583ca => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:45:11.533331 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:11.534103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:11.539244 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:11.541401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:11.551336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:11.552060 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:11.552664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:11.553485 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:11.553938 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:11.554498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:11.595633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-24024be6-a499-4c4c-8a45-99799ac6d77d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063668 Aug 24 03:45:11.596237 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 458/913] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:11 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:12.610791 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:12.613147 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:12.619827 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.620344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.620783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:12.621480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:12.621940 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:12.622404 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:12.656819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-24773dcb-f7c7-400c-8ad8-e6447a071cc1 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051412 Aug 24 03:45:12.657432 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 456/914] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:12 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:13.671556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.673716 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.679894 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.680378 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.680817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.681505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.681965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.682428 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.713495 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8ccab29d-139a-4b03-8097-70a748fbddf7 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045843 Aug 24 03:45:13.714071 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 459/915] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:45:13 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:45:13.794224 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.794852 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.801753 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.802254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.802686 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.803373 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.803819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.804244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.830202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:13.913005 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d9435b70-95c2-4f45-878b-71993d0fee3a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "DELETE /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 204 len: 0 microversion: 2.1 time: 0.122016 Aug 24 03:45:13.914008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 457/916] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:13 2022] DELETE /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:45:13.924023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:13.924632 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:13.930792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.931278 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.931714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:13.932410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:13.932866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:13.933294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:14.077585 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:14.092037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-56408e1a-88b3-4f9d-87d3-40e7a98ef9b3 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1690 microversion: 2.1 time: 0.172390 Aug 24 03:45:14.093027 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 460/917] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:13 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:15.125430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:15.126123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:15.132713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:15.133203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:15.133646 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:15.134416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:15.134877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:15.135307 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:15.267311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:15.275730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a9858361-3d4e-4e5b-ad4d-1bc5cff6a976 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1690 microversion: 2.1 time: 0.154496 Aug 24 03:45:15.276290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 458/918] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:15 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:16.297223 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:16.297822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:16.304791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:16.305271 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:16.305711 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:16.306437 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:16.306892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:16.307318 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:16.436696 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:16.444989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d8a0124d-38e9-43fe-a73f-413866682263 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1690 microversion: 2.1 time: 0.151922 Aug 24 03:45:16.445555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 461/919] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:16 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:17.466448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:17.467063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:17.476144 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:17.476794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:17.477488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:17.478370 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:17.478836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:17.479268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:17.634752 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:17.642591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-41bb669f-ae1d-407f-9f9a-e9ff037d467f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1690 microversion: 2.1 time: 0.179979 Aug 24 03:45:17.643153 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 459/920] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:17 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:18.664197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:18.664903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:18.672130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:18.672625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:18.673057 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:18.673756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:18.674236 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:18.674647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:18.822444 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:18.832889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0ea89e5f-58ec-4311-974f-16bf325c31b0 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1690 microversion: 2.1 time: 0.172851 Aug 24 03:45:18.833490 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 462/921] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:18 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:19.731300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-bc45be69-7238-43df-a8a9-a3bf58ff739b req-1072ffe3-ef39-4238-b6b1-ed5fe42e478a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6560bb95-66b1-4d4f-a87b-4bc63cd92674", "name": "network-vif-deleted", "tag": "38238e64-0e40-4fe3-b325-5d4013cfe9ab"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:19.741976 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bc45be69-7238-43df-a8a9-a3bf58ff739b req-1072ffe3-ef39-4238-b6b1-ed5fe42e478a service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:19.742588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bc45be69-7238-43df-a8a9-a3bf58ff739b req-1072ffe3-ef39-4238-b6b1-ed5fe42e478a service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:19.743018 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-bc45be69-7238-43df-a8a9-a3bf58ff739b req-1072ffe3-ef39-4238-b6b1-ed5fe42e478a service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:19.754961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-bc45be69-7238-43df-a8a9-a3bf58ff739b req-1072ffe3-ef39-4238-b6b1-ed5fe42e478a service nova] Creating event network-vif-deleted:38238e64-0e40-4fe3-b325-5d4013cfe9ab for instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 on hv-cinder-85426 Aug 24 03:45:19.760902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-bc45be69-7238-43df-a8a9-a3bf58ff739b req-1072ffe3-ef39-4238-b6b1-ed5fe42e478a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033016 Aug 24 03:45:19.761529 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 460/922] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:19.854732 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:19.856096 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:19.863826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:19.864417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:19.865069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:19.865797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:19.866295 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:19.866734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:19.904733 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:19.905263 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:19.905715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:19.906230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lazy-loading 'fault' on Instance uuid 6560bb95-66b1-4d4f-a87b-4bc63cd92674 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:45:19.952620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:19.961324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-01fc4829-5cbc-417d-baea-3ce1727c7a45 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 200 len: 1335 microversion: 2.1 time: 0.110796 Aug 24 03:45:19.961921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 463/923] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:19 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:20.988038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:20.989798 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 6560bb95-66b1-4d4f-a87b-4bc63cd92674] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:20.999340 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:20.999871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:21.000312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:21.001013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:21.001473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:21.001909 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:21.015731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] HTTP exception thrown: Instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 could not be found. Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Request method failure captured: Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 HTTP/1.1 Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzS_5Z0sC_TjWAR5UuUsSS6N-Xmad3SK7CRSIuSAYRNL7uR3byKKjlG0zlW7pk9avvW8cHFgWM7ApKI4DSC6o_h306gtHD_oXQ1re2A8G5jwylKiyVkBxfDPwq8etbqFD6yNjb07nZrGEK9f0-weChEHLkee0f9hcbv1ETzXr2SmGU Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:45:21.017339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 76c0df49fa9342778a56eae098b2f2cd Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 could not be found. Aug 24 03:45:21.019113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '6560bb95-66b1-4d4f-a87b-4bc63cd92674'} Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 could not be found. Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:21.020268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 could not be found. Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 could not be found. Aug 24 03:45:21.021896 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:21.023399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Returning 404 to user: Instance 6560bb95-66b1-4d4f-a87b-4bc63cd92674 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:21.023399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6643d02e-750f-4d40-89e0-08e36bfa087d tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674" status: 404 len: 111 microversion: 2.1 time: 0.039076 Aug 24 03:45:21.023399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 461/924] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:20 2022] GET /compute/v2.1/servers/6560bb95-66b1-4d4f-a87b-4bc63cd92674 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:21.027457 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7b46584f-62da-406d-bec7-52bb71dc21a4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '.version_select at 0x7f077f835940>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:21.046007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7b46584f-62da-406d-bec7-52bb71dc21a4 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-877861284" status: 202 len: 0 microversion: 2.1 time: 0.022281 Aug 24 03:45:21.046762 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 464/925] 10.222.0.91 () {58 vars in 1218 bytes} [Wed Aug 24 03:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-877861284 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:45:23.918328 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:23.918875 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:23.925600 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:23.926093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:23.927154 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:23.927853 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:23.928311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:23.928738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:23.956351 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:24.043154 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a6478968-0524-4654-a122-25658f113d24 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "DELETE /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 204 len: 0 microversion: 2.1 time: 0.128193 Aug 24 03:45:24.043989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 462/926] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:23 2022] DELETE /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:45:24.053336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:24.053942 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:24.061013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:24.061502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:24.061935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:24.062852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:24.063296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:24.063715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:24.203700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:24.211936 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-df9744b4-3172-4a2f-83e2-a496814310f6 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1508 microversion: 2.1 time: 0.163339 Aug 24 03:45:24.212439 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 465/927] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:24 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:25.233750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:25.234663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:25.241534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:25.242024 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:25.242490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:25.243195 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:25.243650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:25.244072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:25.460876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:25.470046 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-de3c8513-cf36-4804-8b53-c6af99c59760 tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 200 len: 1508 microversion: 2.1 time: 0.240482 Aug 24 03:45:25.470679 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 463/928] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:25 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:25.679860 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-bf7b0de7-9c49-44d5-9692-8e4f07794d97 req-5728f17c-b02c-4daf-991d-a302212fa2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b8aee4-3b6d-456c-8b11-b1616f1447ce", "name": "network-vif-deleted", "tag": "708a6aa3-e1e7-4841-a71a-401bf123e882"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:25.690272 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-bf7b0de7-9c49-44d5-9692-8e4f07794d97 req-5728f17c-b02c-4daf-991d-a302212fa2b6 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:25.690754 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-bf7b0de7-9c49-44d5-9692-8e4f07794d97 req-5728f17c-b02c-4daf-991d-a302212fa2b6 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:25.691194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-bf7b0de7-9c49-44d5-9692-8e4f07794d97 req-5728f17c-b02c-4daf-991d-a302212fa2b6 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:25.702856 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-bf7b0de7-9c49-44d5-9692-8e4f07794d97 req-5728f17c-b02c-4daf-991d-a302212fa2b6 service nova] Creating event network-vif-deleted:708a6aa3-e1e7-4841-a71a-401bf123e882 for instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce on hv-cinder-85426 Aug 24 03:45:25.708061 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-bf7b0de7-9c49-44d5-9692-8e4f07794d97 req-5728f17c-b02c-4daf-991d-a302212fa2b6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031825 Aug 24 03:45:25.710388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 466/929] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:26.491223 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:26.491777 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 10b8aee4-3b6d-456c-8b11-b1616f1447ce] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:26.498266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:26.498749 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:26.499190 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:26.499881 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:26.500338 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:26.500762 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:26.513990 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] HTTP exception thrown: Instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce could not be found. Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Request method failure captured: Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce HTTP/1.1 Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzS_5Z0sC_TjWAR5UuUsSS6N-Xmad3SK7CRSIuSAYRNL7uR3byKKjlG0zlW7pk9avvW8cHFgWM7ApKI4DSC6o_h306gtHD_oXQ1re2A8G5jwylKiyVkBxfDPwq8etbqFD6yNjb07nZrGEK9f0-weChEHLkee0f9hcbv1ETzXr2SmGU Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:45:26.516447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 76c0df49fa9342778a56eae098b2f2cd Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce could not be found. Aug 24 03:45:26.518598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '10b8aee4-3b6d-456c-8b11-b1616f1447ce'} Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce could not be found. Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:26.519547 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce could not be found. Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce could not be found. Aug 24 03:45:26.521221 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:45:26.523167 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Returning 404 to user: Instance 10b8aee4-3b6d-456c-8b11-b1616f1447ce could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:26.523167 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c62060ee-9815-4b45-b2fa-671464efc80f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce" status: 404 len: 111 microversion: 2.1 time: 0.029937 Aug 24 03:45:26.523167 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 464/930] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:26 2022] GET /compute/v2.1/servers/10b8aee4-3b6d-456c-8b11-b1616f1447ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:26.526936 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:26.527595 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:26.533692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:26.534416 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:26.534627 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:26.535323 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:26.536086 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:26.536252 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:26.561565 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Going to try to terminate instance {{(pid=127259) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:26.644238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0e4af2e6-9e0c-4621-84d8-9334ee292d8a tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 204 len: 0 microversion: 2.1 time: 0.121266 Aug 24 03:45:26.644846 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 467/931] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:26 2022] DELETE /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:45:26.655181 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:26.655181 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:26.661354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:26.661775 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:26.662786 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:26.663585 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:26.663936 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:26.664359 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:26.814339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:26.826286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-34c2f28c-f984-4bd3-b156-960e119888de tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.176421 Aug 24 03:45:26.826861 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 465/932] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:26 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:27.847788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:27.848489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:27.856731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:27.856731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:27.856731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:27.857287 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:27.857753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:27.858171 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:28.009181 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c0df49fa9342778a56eae098b2f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9494dfc650374d64bf4b5f46259a0171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:28.017084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0737d98a-1483-4d69-8c6b-c1e5f360de3f tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 200 len: 1521 microversion: 2.1 time: 0.173534 Aug 24 03:45:28.017659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 468/933] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:27 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:28.349950 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-5d50fd79-f59f-492b-afda-0b71091f47a5 req-8428790a-9427-40f8-8157-a7debde8f8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d87bb42-638e-4844-85c4-d34fdd734471", "name": "network-vif-deleted", "tag": "4f6a3697-3452-41bc-9a68-6461e05b8d14"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:28.360104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5d50fd79-f59f-492b-afda-0b71091f47a5 req-8428790a-9427-40f8-8157-a7debde8f8ce service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:28.360502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5d50fd79-f59f-492b-afda-0b71091f47a5 req-8428790a-9427-40f8-8157-a7debde8f8ce service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:28.360957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-5d50fd79-f59f-492b-afda-0b71091f47a5 req-8428790a-9427-40f8-8157-a7debde8f8ce service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:28.372431 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-5d50fd79-f59f-492b-afda-0b71091f47a5 req-8428790a-9427-40f8-8157-a7debde8f8ce service nova] Creating event network-vif-deleted:4f6a3697-3452-41bc-9a68-6461e05b8d14 for instance 1d87bb42-638e-4844-85c4-d34fdd734471 on hv-cinder-85426 Aug 24 03:45:28.377247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-5d50fd79-f59f-492b-afda-0b71091f47a5 req-8428790a-9427-40f8-8157-a7debde8f8ce service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030926 Aug 24 03:45:28.378066 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 466/934] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:29.039566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:29.040182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] [instance: 1d87bb42-638e-4844-85c4-d34fdd734471] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:29.047043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:29.047534 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:29.047983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:29.048698 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:29.049158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:29.049586 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:29.064781 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] HTTP exception thrown: Instance 1d87bb42-638e-4844-85c4-d34fdd734471 could not be found. Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Request method failure captured: Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 HTTP/1.1 Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzS_5Z0sC_TjWAR5UuUsSS6N-Xmad3SK7CRSIuSAYRNL7uR3byKKjlG0zlW7pk9avvW8cHFgWM7ApKI4DSC6o_h306gtHD_oXQ1re2A8G5jwylKiyVkBxfDPwq8etbqFD6yNjb07nZrGEK9f0-weChEHLkee0f9hcbv1ETzXr2SmGU Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:45:29.066611 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9494dfc650374d64bf4b5f46259a0171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 9494dfc650374d64bf4b5f46259a0171 Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594635728 Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 76c0df49fa9342778a56eae098b2f2cd Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594635728-project Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 1d87bb42-638e-4844-85c4-d34fdd734471 could not be found. Aug 24 03:45:29.068013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '1d87bb42-638e-4844-85c4-d34fdd734471'} Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d87bb42-638e-4844-85c4-d34fdd734471 could not be found. Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:29.068822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d87bb42-638e-4844-85c4-d34fdd734471 could not be found. Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d87bb42-638e-4844-85c4-d34fdd734471 could not be found. Aug 24 03:45:29.070302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:45:29.072002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] Returning 404 to user: Instance 1d87bb42-638e-4844-85c4-d34fdd734471 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:29.072002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2b9ea7d3-79f7-48c9-8bfc-0b1bf6c21c2e tempest-ServerRescueNegativeTestJSON-1594635728 tempest-ServerRescueNegativeTestJSON-1594635728-project] 10.222.0.91 "GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471" status: 404 len: 111 microversion: 2.1 time: 0.032853 Aug 24 03:45:29.072002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 469/935] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:29 2022] GET /compute/v2.1/servers/1d87bb42-638e-4844-85c4-d34fdd734471 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:38.946201 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:38.946994 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:39.135091 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3dabc44c-4cb6-4b98-a1c2-82d635eee931 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'create', calling method: .version_select at 0x7f077c0c7550>, body: {"keypair": {"name": "tempest-keypair-253236526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8A4JocHJTF+hmOY/pL6viu+UOqtKf4GMGBJ6JlRdRfpfeC4LxF2k4ODI4czbrYvxT1q6YEE1aHy2W1KFVxS0rN+isC7ojvrYfJUEFvhPpxSTMvF9Q5QejYR8OwfrFFg=="}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:39.151522 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-3dabc44c-4cb6-4b98-a1c2-82d635eee931 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Getting quotas for project 28b19b24989f449094001356712fc0e0. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:45:39.155695 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-3dabc44c-4cb6-4b98-a1c2-82d635eee931 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Getting quotas for user fe0dc1ce495045e4bf158ec503a5b5d1 and project 28b19b24989f449094001356712fc0e0. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:45:39.180524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3dabc44c-4cb6-4b98-a1c2-82d635eee931 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.235852 Aug 24 03:45:39.181130 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 467/936] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:45:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:40.759369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-484022772", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f381488-2c35-4d4e-890e-cd2d9dbf6306"}], "security_groups": [{"name": "tempest-securitygroup--1616968687"}], "key_name": "tempest-keypair-253236526", "user_data": "}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:40.768295 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:40.769035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:40.885672 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] validate_networks() for [('3f381488-2c35-4d4e-890e-cd2d9dbf6306', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:45:41.322901 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:45:41.323326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:45:41.323823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:45:41.324234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:45:41.324703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:45:41.334721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.335457 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.335892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.336614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.337071 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.337499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.355705 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Getting quotas for project 28b19b24989f449094001356712fc0e0. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:45:41.361607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Getting quotas for user fe0dc1ce495045e4bf158ec503a5b5d1 and project 28b19b24989f449094001356712fc0e0. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:45:41.375437 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:45:41.378392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:45:41.431750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1c661df8-dd1b-470c-91eb-ba71a6f83d7a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.677265 Aug 24 03:45:41.438941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 470/937] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:45:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:45:41.451468 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-baa302d7-aee6-4176-9b00-9e7d36987480 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.457454 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-baa302d7-aee6-4176-9b00-9e7d36987480 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:41.563464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-baa302d7-aee6-4176-9b00-9e7d36987480 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:41.575262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-baa302d7-aee6-4176-9b00-9e7d36987480 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1236 microversion: 2.1 time: 0.134406 Aug 24 03:45:41.577473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 468/938] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1236 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:42.597826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:42.598542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:42.606573 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:42.607072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:42.607504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:42.608215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:42.608666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:42.609099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:42.679681 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:42.694175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-203e84f9-3524-4060-807c-90df9af83146 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1288 microversion: 2.1 time: 0.099820 Aug 24 03:45:42.695035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 471/939] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:42 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:43.717573 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:43.718338 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:43.727052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.727650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.728308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.728994 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.729577 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.729954 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.985287 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:43.997105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-62d49a01-70fe-48ed-a76e-753d43953c12 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.283325 Aug 24 03:45:43.997881 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 469/940] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:43 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:44.414880 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-4d809b58-bccd-460e-b126-6b065785b600 req-64f39307-700a-4f44-bf29-129dcd02041a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9453748-a38e-47eb-a18d-321371e80d31", "tag": "eb86f147-1646-4029-8889-07eb61d9e986"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:44.425258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-4d809b58-bccd-460e-b126-6b065785b600 req-64f39307-700a-4f44-bf29-129dcd02041a service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.425828 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-4d809b58-bccd-460e-b126-6b065785b600 req-64f39307-700a-4f44-bf29-129dcd02041a service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.426617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-4d809b58-bccd-460e-b126-6b065785b600 req-64f39307-700a-4f44-bf29-129dcd02041a service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.438980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-4d809b58-bccd-460e-b126-6b065785b600 req-64f39307-700a-4f44-bf29-129dcd02041a service nova] Creating event network-changed:eb86f147-1646-4029-8889-07eb61d9e986 for instance b9453748-a38e-47eb-a18d-321371e80d31 on hv-cinder-85426 Aug 24 03:45:44.444166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-4d809b58-bccd-460e-b126-6b065785b600 req-64f39307-700a-4f44-bf29-129dcd02041a service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033937 Aug 24 03:45:44.444747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 472/941] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:45.019969 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:45.020572 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:45.027699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:45.028181 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:45.028605 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.029299 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:45.029745 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:45.030163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.204054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.212093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-417ee872-bb1e-4be3-8260-850eb96d7094 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.195995 Aug 24 03:45:45.212653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 470/942] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:45 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:46.234019 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:46.234883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:46.241649 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.242148 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.242604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.243291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.243745 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.244171 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.384547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.392655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-34262c49-616d-47c5-8291-224087678044 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.163302 Aug 24 03:45:46.393221 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 473/943] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:46 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:47.413630 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:47.414306 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:47.420697 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.421175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.421609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.422324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.422781 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.423202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.550205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:47.557887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c205f486-67a9-42a4-89ea-db604d1193e0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.148808 Aug 24 03:45:47.558464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 471/944] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:47 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:48.580208 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:48.580901 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:48.588397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:48.588877 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:48.589309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:48.590003 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:48.590512 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:48.591062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:48.735935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:48.744026 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-cd906d3c-04ff-4044-9090-4e8a147240a6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.167706 Aug 24 03:45:48.744594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 474/945] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:48 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:49.765093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:49.765698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:49.772589 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.773078 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.773519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.774248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:49.774704 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:49.775705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.936619 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.945281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-19664f33-bb0b-4909-b441-036a4cb8b761 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.184026 Aug 24 03:45:49.945877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 472/946] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:49 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:45:50.966996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:50.967722 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:50.974219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.974714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.975128 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.975806 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.976255 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.976675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.104114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.111962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b48107b3-6d7a-4814-9cfb-5c31c46d9cad tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.148736 Aug 24 03:45:51.112531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 475/947] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:50 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:51.803203 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-4d1c956d-5cb1-4ebe-9c80-57b5c9a08ddd req-6385d304-76b0-45d0-90e1-30b543c84da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9453748-a38e-47eb-a18d-321371e80d31", "name": "network-vif-plugged", "status": "completed", "tag": "eb86f147-1646-4029-8889-07eb61d9e986"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:51.808563 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=6 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:51.815094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-4d1c956d-5cb1-4ebe-9c80-57b5c9a08ddd req-6385d304-76b0-45d0-90e1-30b543c84da1 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.815606 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-4d1c956d-5cb1-4ebe-9c80-57b5c9a08ddd req-6385d304-76b0-45d0-90e1-30b543c84da1 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.816031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-4d1c956d-5cb1-4ebe-9c80-57b5c9a08ddd req-6385d304-76b0-45d0-90e1-30b543c84da1 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.828937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-4d1c956d-5cb1-4ebe-9c80-57b5c9a08ddd req-6385d304-76b0-45d0-90e1-30b543c84da1 service nova] Creating event network-vif-plugged:eb86f147-1646-4029-8889-07eb61d9e986 for instance b9453748-a38e-47eb-a18d-321371e80d31 on hv-cinder-85426 Aug 24 03:45:51.834765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-4d1c956d-5cb1-4ebe-9c80-57b5c9a08ddd req-6385d304-76b0-45d0-90e1-30b543c84da1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034713 Aug 24 03:45:51.835397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 473/948] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:52.132678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:52.133284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:52.135274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:52.135932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:52.142494 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.143218 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.143661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.144388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.144843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.145269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.280566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.291253 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-79fba834-0cc0-4785-9415-e350e4c4246e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.159961 Aug 24 03:45:52.294021 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 476/949] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:52 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:53.317336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:53.318032 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:53.324551 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:53.325037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:53.325474 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:53.326172 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:53.326645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:53.327071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:53.462757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:53.470634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-839735c8-eebf-4edb-997b-99122000607c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1362 microversion: 2.1 time: 0.157852 Aug 24 03:45:53.471211 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 474/950] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:53 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:54.494926 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:54.496067 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:54.506519 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.507012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.507453 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.508163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.508620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.509046 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.647291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:54.654998 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4dcafc26-0541-4544-92d6-1bc2b45eee9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1547 microversion: 2.1 time: 0.166400 Aug 24 03:45:54.655571 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 477/951] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:54 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:54.675933 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:54.676646 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:54.683690 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.684177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.684623 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.685327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.685782 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.686228 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.767206 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-aa8c3cc4-b1ef-4ed0-b832-62daddc01599 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095217 Aug 24 03:45:54.767816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 475/952] 10.222.0.91 () {58 vars in 1275 bytes} [Wed Aug 24 03:45:54 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:55.704862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-18845f39-1b6f-4efd-a3eb-aba8d11422e9 req-e8ec6a2c-f4e4-4bc9-8b4e-559d06fcff37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9453748-a38e-47eb-a18d-321371e80d31", "tag": "eb86f147-1646-4029-8889-07eb61d9e986"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:55.714847 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-18845f39-1b6f-4efd-a3eb-aba8d11422e9 req-e8ec6a2c-f4e4-4bc9-8b4e-559d06fcff37 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:55.715318 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-18845f39-1b6f-4efd-a3eb-aba8d11422e9 req-e8ec6a2c-f4e4-4bc9-8b4e-559d06fcff37 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:55.715745 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-18845f39-1b6f-4efd-a3eb-aba8d11422e9 req-e8ec6a2c-f4e4-4bc9-8b4e-559d06fcff37 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:55.727250 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-18845f39-1b6f-4efd-a3eb-aba8d11422e9 req-e8ec6a2c-f4e4-4bc9-8b4e-559d06fcff37 service nova] Creating event network-changed:eb86f147-1646-4029-8889-07eb61d9e986 for instance b9453748-a38e-47eb-a18d-321371e80d31 on hv-cinder-85426 Aug 24 03:45:55.732439 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-18845f39-1b6f-4efd-a3eb-aba8d11422e9 req-e8ec6a2c-f4e4-4bc9-8b4e-559d06fcff37 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031283 Aug 24 03:45:55.733993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 478/953] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:11.109603 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:11.110813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=36 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:11.114960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:11.115444 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:11.123009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:11.123484 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:11.123910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:11.124583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:11.125026 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:11.125442 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:11.149060 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b23a443d-d3de-411b-910e-c0d57092b37c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/ips" status: 200 len: 150 microversion: 2.1 time: 0.040898 Aug 24 03:46:11.149611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 476/954] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:46:11 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:12.483066 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:12.483810 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=42 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:12.488074 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "772ecb4a-81db-47fd-bf58-3e4cb598374a"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:12.490478 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:12.497697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.498200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.498641 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.499349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.499799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.500214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.778787 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3aac4f93-b1ae-4673-9648-ae9d39c329d4 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297034 Aug 24 03:46:12.779388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 479/955] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:46:12 2022] POST /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:13.194272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:13.195320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:13.201991 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.202515 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.202952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.203647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.204100 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.204534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.230618 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-61729f93-23f9-48f6-a60e-03aac97358a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/ips" status: 200 len: 151 microversion: 2.20 time: 0.040059 Aug 24 03:46:13.231199 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 477/956] 10.222.0.91 () {60 vars in 1289 bytes} [Wed Aug 24 03:46:13 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:46:15.594041 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:15.594716 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:15.600820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:15.601297 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:15.601734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:15.602429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:15.602874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:15.603289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:15.627042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lazy-loading 'flavor' on Instance uuid 684ce0ff-fd32-480d-ba7c-07d564e2a702 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:46:15.805471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bef8856d-4b07-4149-8fa6-7b0ec1c0cdfc tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/action" status: 202 len: 0 microversion: 2.20 time: 0.215940 Aug 24 03:46:15.806068 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 480/957] 10.222.0.91 () {62 vars in 1319 bytes} [Wed Aug 24 03:46:15 2022] POST /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:46:15.814413 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:15.815015 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:15.822673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:15.823239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:15.823665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:15.824383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:15.824831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:15.825251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:15.958003 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:15.966593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:15.968071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:15.969220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-0540379e-9588-45ac-843d-218380812dbb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.158926 Aug 24 03:46:15.969776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 478/958] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:15 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:16.996324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:16.997055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:17.004113 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.004597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.005039 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.005729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.006203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.006645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.140166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:17.148194 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:17.149709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:17.150893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2426b145-b6d3-4351-abb8-f1fb4c4bf694 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.159323 Aug 24 03:46:17.151450 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 481/959] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:16 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:18.172769 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:18.173364 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:18.179880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:18.180403 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:18.180835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:18.181515 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:18.181960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:18.182412 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:18.310364 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:18.318594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:18.320079 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:18.321738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c84a891e-d773-42f4-8956-4814d4a0d723 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.152783 Aug 24 03:46:18.322315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 479/960] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:18 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:19.344817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:19.345446 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:19.351850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:19.352326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:19.352758 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:19.353440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:19.353882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:19.354330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:19.481775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.489910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.491467 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.493127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e707de53-ae40-47f1-aac4-c71e5a6ec83e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.151746 Aug 24 03:46:19.493686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 482/961] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:19 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:20.301923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "772ecb4a-81db-47fd-bf58-3e4cb598374a"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:20.304328 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.311346 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.311827 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.312262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.312949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.313654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.314074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.391300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Invalid volume: volume 772ecb4a-81db-47fd-bf58-3e4cb598374a is already attached to instances: e94e4298-9115-41cc-9220-252b7e0781d1 Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: POST /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments HTTP/1.1 Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 74 Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:46:20.393040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {"volumeAttachment": {"volumeId": "772ecb4a-81db-47fd-bf58-3e4cb598374a"}} Aug 24 03:46:20.394658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Invalid volume: volume 772ecb4a-81db-47fd-bf58-3e4cb598374a is already attached to instances: e94e4298-9115-41cc-9220-252b7e0781d1 Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'server_id': 'e94e4298-9115-41cc-9220-252b7e0781d1', 'body': {'volumeAttachment': {'volumeId': '772ecb4a-81db-47fd-bf58-3e4cb598374a'}}} Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 772ecb4a-81db-47fd-bf58-3e4cb598374a is already attached to instances: e94e4298-9115-41cc-9220-252b7e0781d1 Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:46:20.395821 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 772ecb4a-81db-47fd-bf58-3e4cb598374a is already attached to instances: e94e4298-9115-41cc-9220-252b7e0781d1 Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:20.397327 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:20.399031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:20.399031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:20.399031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:20.399031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 772ecb4a-81db-47fd-bf58-3e4cb598374a is already attached to instances: e94e4298-9115-41cc-9220-252b7e0781d1 Aug 24 03:46:20.399031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:46:20.399031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 400 to user: Invalid volume: volume 772ecb4a-81db-47fd-bf58-3e4cb598374a is already attached to instances: e94e4298-9115-41cc-9220-252b7e0781d1 {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:20.399031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a3932c43-ce88-41e6-b5ae-5b81f2183ecc tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096635 Aug 24 03:46:20.399031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 480/962] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:46:20 2022] POST /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:46:20.458717 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:20.459206 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.465752 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.466240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.466687 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.467404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.467885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.468312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.515372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:20.515989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.522094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.523103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.523230 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.523857 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.524314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.524776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.552126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lazy-loading 'services' on Instance uuid e94e4298-9115-41cc-9220-252b7e0781d1 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:46:20.632978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6fc34f32-1a33-404c-89fa-3fb9f47cfc70 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments/772ecb4a-81db-47fd-bf58-3e4cb598374a" status: 202 len: 0 microversion: 2.1 time: 0.177826 Aug 24 03:46:20.634163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 483/963] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:46:20 2022] DELETE /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments/772ecb4a-81db-47fd-bf58-3e4cb598374a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:46:20.642947 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:20.645349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.651829 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.652320 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.652753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.653468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.654065 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.654391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.661215 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.669937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.671527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.672712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-728ba0cd-7c57-4463-961c-08cc74b83f0b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.161613 Aug 24 03:46:20.686523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 481/964] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:20 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:20.689355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4ad90b26-ad91-4aeb-8947-79109a2fc873 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049455 Aug 24 03:46:20.689355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 484/965] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:46:20 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:21.696783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.697396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:21.700909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.703131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:21.703868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.704354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.704783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.705472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.705917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.706371 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.709459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.709939 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.710416 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.711108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.712082 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.712494 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.741548 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-de39d164-948e-4629-bbc8-015aac0b3ce9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044490 Aug 24 03:46:21.742118 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 485/966] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:46:21.804301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.804799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:21.810747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.811227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.811663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.812351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.812811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.813510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.838968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Going to try to terminate instance {{(pid=127259) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:21.843450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:21.851676 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:21.853850 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:21.855106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7e908170-479d-4c81-80f7-0da51ca7a681 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.162217 Aug 24 03:46:21.855742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 482/967] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:21.916524 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-79476cca-4408-40d3-8bb5-d54748af2811 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 204 len: 0 microversion: 2.1 time: 0.116440 Aug 24 03:46:21.917274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 486/968] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:46:21 2022] DELETE /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:46:21.927014 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.927654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:21.934151 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.934670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.935135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.936009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.936617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.937045 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.067125 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:22.074820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-98a718ac-fb19-46d2-9212-85133c4c3994 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1681 microversion: 2.1 time: 0.151999 Aug 24 03:46:22.075361 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 483/969] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:22.880073 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:22.880759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:22.887542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.888016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.888448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.889125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.889572 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.889990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.020786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:23.028858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:23.030397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:23.031550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e7d48926-8c11-414a-9189-34c5f96badd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.155689 Aug 24 03:46:23.032107 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 487/970] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:22 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:23.096128 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:23.096746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:23.103682 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.104170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.104612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.105308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.105765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.106214 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.236673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:23.244921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-959d487f-e43a-434a-94d6-5755749e1876 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1681 microversion: 2.1 time: 0.152713 Aug 24 03:46:23.245540 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 484/971] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:23 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:24.054566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:24.055684 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:24.062093 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.062610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.063050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.064002 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.064460 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.064889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.196786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:24.205496 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:24.207035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:24.208210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e8916a53-ae7b-4ef4-92e3-f2f13d4cbb03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.157573 Aug 24 03:46:24.209007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 488/972] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:24 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:24.266889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:24.267535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:24.273886 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.275019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.275457 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.276158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.276612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.277052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.494407 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:24.502040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6be6a355-c8bb-4277-9ffb-71e2baa80f6c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1681 microversion: 2.1 time: 0.238990 Aug 24 03:46:24.502745 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 485/973] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:24 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:25.124645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-3f224936-2bd6-4842-b2a3-2c9f91392249 req-41982178-1f95-4efa-9355-c2023951685e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e94e4298-9115-41cc-9220-252b7e0781d1", "name": "network-vif-deleted", "tag": "da87d65f-39b6-4d02-8533-ddf918ad0857"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:25.135183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3f224936-2bd6-4842-b2a3-2c9f91392249 req-41982178-1f95-4efa-9355-c2023951685e service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.135660 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3f224936-2bd6-4842-b2a3-2c9f91392249 req-41982178-1f95-4efa-9355-c2023951685e service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.136089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3f224936-2bd6-4842-b2a3-2c9f91392249 req-41982178-1f95-4efa-9355-c2023951685e service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.147488 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-3f224936-2bd6-4842-b2a3-2c9f91392249 req-41982178-1f95-4efa-9355-c2023951685e service nova] Creating event network-vif-deleted:da87d65f-39b6-4d02-8533-ddf918ad0857 for instance e94e4298-9115-41cc-9220-252b7e0781d1 on hv-cinder-85426 Aug 24 03:46:25.152815 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-3f224936-2bd6-4842-b2a3-2c9f91392249 req-41982178-1f95-4efa-9355-c2023951685e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031761 Aug 24 03:46:25.153423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 489/974] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:25.230719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:25.231866 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:25.239652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.240281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.240847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.241820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.242438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.243130 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.395192 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:25.403485 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:25.405218 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:25.406482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-546c2d1b-355c-4ec9-b2a1-cdcd87590279 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.179582 Aug 24 03:46:25.407117 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 486/975] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:25 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:25.523934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:25.524639 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:25.531078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.531565 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.532000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.532690 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.533146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.533589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.551523 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.567930 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.568407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.568844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.569296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lazy-loading 'fault' on Instance uuid e94e4298-9115-41cc-9220-252b7e0781d1 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:46:25.610939 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:25.619069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4eb21d6f-6e9f-44e2-b5b4-3fe3b5fe8b38 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 200 len: 1331 microversion: 2.1 time: 0.099402 Aug 24 03:46:25.619633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 490/976] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:25 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:26.429786 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:26.430956 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:26.437354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.437841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.438562 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.439262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.439718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.440146 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.572447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:26.583818 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:26.585318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:26.586512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e1d1c3c9-62a8-4dcf-9be9-f0cbe754e8e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.160599 Aug 24 03:46:26.587068 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 487/977] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:26 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:26.639959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:26.640566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:26.647057 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.647535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.647969 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.648648 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.649100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.649520 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.662491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 HTTP/1.1 Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:46:26.664092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:46:26.666222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': 'e94e4298-9115-41cc-9220-252b7e0781d1'} Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:26.667294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:46:26.668793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:26.670216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:26.670216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6266e2f1-cf1c-4e14-a121-3c11d34f1ed9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 404 len: 111 microversion: 2.1 time: 0.029871 Aug 24 03:46:26.670216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 491/978] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:26 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:26.674717 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-19f567c3-defc-421d-b677-5a2771b3c5df tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '.version_select at 0x7f077f9bd3a0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:26.693783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-19f567c3-defc-421d-b677-5a2771b3c5df tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670193695" status: 202 len: 0 microversion: 2.1 time: 0.022751 Aug 24 03:46:26.694281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 488/979] 10.222.0.91 () {58 vars in 1221 bytes} [Wed Aug 24 03:46:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670193695 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:46:27.305469 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7aee6c29-03bb-4ac0-8786-6f5fde21b3e7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: .version_select at 0x7f077f8c5040>, body: {"keypair": {"name": "tempest-keypair-1840348796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfJ7+mtIBHDHT9laKFJCH65kmnY6R7eDVmXZzjiD4h1uPhk3DWvtznfpnOyS03vE7VhVDq/ZNWw/nF2bdwueJ9JyAq1p6qXlodpMjESlYAQotieJaXknaTMPWg0CgZc8Q=="}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:27.321509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-7aee6c29-03bb-4ac0-8786-6f5fde21b3e7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for project c7c94d613f6b440bae60fc442661c671. Resources: {'key_pairs'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:46:27.325372 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-7aee6c29-03bb-4ac0-8786-6f5fde21b3e7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for user b1d9d5fd0db54ddf85e05c77dd7f6c89 and project c7c94d613f6b440bae60fc442661c671. Resources: {'key_pairs'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:46:27.347984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7aee6c29-03bb-4ac0-8786-6f5fde21b3e7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046506 Aug 24 03:46:27.348677 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 492/980] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:46:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:27.609351 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:27.609973 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:27.617464 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:27.618576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:27.619157 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:27.620075 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:27.620540 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:27.621258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:28.010625 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:28.022316 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:28.023948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:28.025142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-84c6ff84-820c-43b7-a444-a1ca15ca9356 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.419747 Aug 24 03:46:28.025700 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 489/981] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:27 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:28.671706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1028016053", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "179f4006-1dcb-402a-823f-dec3eb79c3e6"}], "security_groups": [{"name": "tempest-securitygroup--672120875"}], "key_name": "tempest-keypair-1840348796", "user_data": "}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:28.784950 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] validate_networks() for [('179f4006-1dcb-402a-823f-dec3eb79c3e6', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:46:29.049022 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.049594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:29.056932 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.057428 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.057880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.058617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.059074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.059502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.170626 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:46:29.171047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:46:29.171514 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:46:29.171944 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:46:29.172359 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:46:29.181498 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.181966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.182426 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.183137 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:29.183582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:29.183999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:29.201451 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for project c7c94d613f6b440bae60fc442661c671. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:46:29.205641 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Getting quotas for user b1d9d5fd0db54ddf85e05c77dd7f6c89 and project c7c94d613f6b440bae60fc442661c671. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:46:29.216605 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:46:29.219162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:46:29.244519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:29.253546 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:29.255114 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:29.256267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-42c558f3-e905-427c-ae2b-5ad9d65832a3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.211820 Aug 24 03:46:29.257009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 490/982] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:29 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:29.265581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0bb5c05a-5b5a-45d9-b1f5-a41f1fff99b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.598728 Aug 24 03:46:29.266230 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 493/983] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:46:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:46:29.281661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a45f4c65-f0da-4bb8-8724-bb00c63bee26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:29.282430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a45f4c65-f0da-4bb8-8724-bb00c63bee26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:29.335032 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a45f4c65-f0da-4bb8-8724-bb00c63bee26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:29.342572 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a45f4c65-f0da-4bb8-8724-bb00c63bee26 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1242 microversion: 2.1 time: 0.064815 Aug 24 03:46:29.343244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 491/984] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:29 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:30.280836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:30.281680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:30.290888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.291967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.292418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.293331 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.293787 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.294245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.364187 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:30.365632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:30.376775 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.377817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.378512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.380241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:30.380644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:30.381165 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:30.443390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:30.454320 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:30.457287 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:30.459407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e278c324-ada5-468e-90db-60dddd119527 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.183676 Aug 24 03:46:30.460259 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:30.460636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 494/985] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:30 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:30.476919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-52059d4d-9bac-43a5-99dd-e598bc469ee7 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1312 microversion: 2.1 time: 0.117128 Aug 24 03:46:30.477486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 492/986] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:30 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:31.484277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:31.484911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:31.491852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.492401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.492904 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.493750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.494889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.495399 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.502799 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:31.504298 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:31.511075 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.511913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.512586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.514239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.514949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.515599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.702213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.710439 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.711945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.713672 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d3a9ad0d-5464-40fa-8ed9-95c4f8f3b4a5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.232817 Aug 24 03:46:31.714241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 495/987] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:31 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:31.748126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:31.756314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cb86b594-88b9-466b-9762-300fe9830dea tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1367 microversion: 2.1 time: 0.260843 Aug 24 03:46:31.756884 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 493/988] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:31 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:31.931053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-feaa197d-8814-492a-99ef-3a00c8287b58 req-bb8684b4-920c-4ce4-95bb-cc28eff92974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684ce0ff-fd32-480d-ba7c-07d564e2a702", "name": "network-vif-plugged", "status": "completed", "tag": "6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:31.945049 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-feaa197d-8814-492a-99ef-3a00c8287b58 req-bb8684b4-920c-4ce4-95bb-cc28eff92974 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.945734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-feaa197d-8814-492a-99ef-3a00c8287b58 req-bb8684b4-920c-4ce4-95bb-cc28eff92974 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.946497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-feaa197d-8814-492a-99ef-3a00c8287b58 req-bb8684b4-920c-4ce4-95bb-cc28eff92974 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:31.961106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-feaa197d-8814-492a-99ef-3a00c8287b58 req-bb8684b4-920c-4ce4-95bb-cc28eff92974 service nova] Creating event network-vif-plugged:6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf for instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 on hv-cinder-85426 Aug 24 03:46:31.966386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-feaa197d-8814-492a-99ef-3a00c8287b58 req-bb8684b4-920c-4ce4-95bb-cc28eff92974 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039576 Aug 24 03:46:31.966977 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 496/989] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:31.970722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-2af114e2-ee7d-4b50-ac88-2775135c48eb req-eb39b55a-7dc8-4673-9bd4-45ef12b61080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0fe121-6b91-46d7-a9f5-b45d32d48d86", "tag": "63488ee4-c4d9-4b58-9efa-1ce9610d00cf"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:31.988767 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2af114e2-ee7d-4b50-ac88-2775135c48eb req-eb39b55a-7dc8-4673-9bd4-45ef12b61080 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:31.989396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2af114e2-ee7d-4b50-ac88-2775135c48eb req-eb39b55a-7dc8-4673-9bd4-45ef12b61080 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:31.989933 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-2af114e2-ee7d-4b50-ac88-2775135c48eb req-eb39b55a-7dc8-4673-9bd4-45ef12b61080 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:32.004278 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-2af114e2-ee7d-4b50-ac88-2775135c48eb req-eb39b55a-7dc8-4673-9bd4-45ef12b61080 service nova] Creating event network-changed:63488ee4-c4d9-4b58-9efa-1ce9610d00cf for instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 on hv-cinder-85426 Aug 24 03:46:32.010533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-2af114e2-ee7d-4b50-ac88-2775135c48eb req-eb39b55a-7dc8-4673-9bd4-45ef12b61080 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042886 Aug 24 03:46:32.011371 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 494/990] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:32.736699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:32.737343 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:32.744256 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:32.744729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:32.745157 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:32.745868 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:32.746454 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:32.746873 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:32.779164 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:32.780989 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:32.787705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:32.788254 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:32.788722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:32.789429 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:32.789898 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:32.790370 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:32.894907 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:32.904648 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:32.906383 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:32.907675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a8c3bb88-a207-4790-a276-e5fc30f2d8c4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.175437 Aug 24 03:46:32.908983 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 497/991] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:32 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:33.071055 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:33.075198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:33.080294 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b1727ae0-ba52-426f-a247-c3d737abdd5d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1367 microversion: 2.1 time: 0.306608 Aug 24 03:46:33.080855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 495/992] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:32 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:33.931493 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:33.932672 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:33.939270 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:33.939747 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:33.940180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:33.940861 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:33.941312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:33.941733 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:34.067787 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:34.075880 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:34.077382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:34.078555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-255e677d-6dcc-4c69-a030-d506f67374b4 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.151007 Aug 24 03:46:34.079299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 498/993] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:33 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:34.100941 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:34.101549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:34.109652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:34.109652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:34.110077 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:34.110806 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:34.111292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:34.111714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:34.240793 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:34.248346 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c2882d51-c139-42ee-80ee-5ce3014e3029 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1367 microversion: 2.1 time: 0.151457 Aug 24 03:46:34.248900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 496/994] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:34 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:35.100965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:35.101576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:35.108877 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.109366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.110636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.111345 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.111805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.112292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.244865 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:35.254950 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:35.256475 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:35.257629 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-594a3472-9ae3-4271-8c07-02b9e86f332d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.160619 Aug 24 03:46:35.258219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 499/995] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:35 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:35.269036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:35.269645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:35.278119 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.278646 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.279085 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.279792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.280249 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.280681 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.522005 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:35.529625 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4ab66378-c7e2-4803-aea3-e0463a2fb45c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1367 microversion: 2.1 time: 0.264764 Aug 24 03:46:35.530209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 497/996] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:35 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:35.979751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:35.980253 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:35.983879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-15fbd157-0263-4886-81ae-254409aa63f9 req-7559c0c9-6a51-42b8-9c58-98ab31a795ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6e4c30-7ab0-446f-8f76-078a95397938", "tag": "c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:35.987037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.987753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.988381 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.989088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.989545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.990220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:35.993945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-15fbd157-0263-4886-81ae-254409aa63f9 req-7559c0c9-6a51-42b8-9c58-98ab31a795ef service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:35.995130 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-15fbd157-0263-4886-81ae-254409aa63f9 req-7559c0c9-6a51-42b8-9c58-98ab31a795ef service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:35.995770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-15fbd157-0263-4886-81ae-254409aa63f9 req-7559c0c9-6a51-42b8-9c58-98ab31a795ef service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.007538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-15fbd157-0263-4886-81ae-254409aa63f9 req-7559c0c9-6a51-42b8-9c58-98ab31a795ef service nova] Creating event network-changed:c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27 for instance dc6e4c30-7ab0-446f-8f76-078a95397938 on hv-cinder-85426 Aug 24 03:46:36.012997 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-15fbd157-0263-4886-81ae-254409aa63f9 req-7559c0c9-6a51-42b8-9c58-98ab31a795ef service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034258 Aug 24 03:46:36.014179 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 498/997] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:36.020863 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Going to try to terminate instance {{(pid=127259) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:36.118369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-65805c68-35cc-4f4f-ac32-28a8016fbf78 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "DELETE /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 204 len: 0 microversion: 2.1 time: 0.142754 Aug 24 03:46:36.120499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 500/998] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:46:35 2022] DELETE /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:36.131307 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:36.132027 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:36.139045 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:36.139540 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:36.139977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.141300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:36.141425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:36.141815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.281773 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:36.282863 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:36.289025 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:36.289516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:36.289949 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.290891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:36.291530 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:36.291960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.298536 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:36.306445 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6fac26dd-f94f-4008-a11d-ef64abfd7315 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.181108 Aug 24 03:46:36.307756 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 499/999] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:36 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:36.442052 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:36.452317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:36.453979 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:36.455197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7d11e382-bbc3-42a4-ad06-a8b61e0a1594 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.177764 Aug 24 03:46:36.455862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 501/1000] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:36 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:36.550486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:36.551097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:36.565332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:36.565838 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:36.566319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.567028 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:36.567484 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:36.567908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:36.702932 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:36.710761 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-557cb761-5a5e-4843-adbf-92a5a2cd8cae tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1367 microversion: 2.1 time: 0.164085 Aug 24 03:46:36.711334 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 500/1001] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:36 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:37.329321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:37.329879 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:37.336366 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:37.336866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:37.337282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:37.337972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:37.338447 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:37.338874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:37.471367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:37.479668 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8c6110fa-fb65-46a1-83c2-2bd24d20e702 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.154252 Aug 24 03:46:37.479931 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:37.480381 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 502/1002] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:37 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:37.480558 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:37.487085 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:37.487572 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:37.488012 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:37.488706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:37.489166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:37.489601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:37.621510 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:37.629693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:37.631260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:37.632446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f3fe1a5a-9488-4d9e-8549-4850cafe57e8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1744 microversion: 2.20 time: 0.156939 Aug 24 03:46:37.633006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 501/1003] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:37 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:37.732212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:37.732750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:37.739234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:37.739486 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:37.739771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:37.740466 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:37.740920 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:37.741342 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:37.881764 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:37.890028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8bc181a0-2856-4dfe-9c36-89c4078a666f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1367 microversion: 2.1 time: 0.162384 Aug 24 03:46:37.890633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 503/1004] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:37 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:38.405617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-56055e21-eba3-4bb4-90c9-3ea742fc126e req-96d69f4d-42a5-42e7-bdcd-2c5c673d410f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0fe121-6b91-46d7-a9f5-b45d32d48d86", "name": "network-vif-plugged", "status": "completed", "tag": "63488ee4-c4d9-4b58-9efa-1ce9610d00cf"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:38.416883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-56055e21-eba3-4bb4-90c9-3ea742fc126e req-96d69f4d-42a5-42e7-bdcd-2c5c673d410f service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:38.417739 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-56055e21-eba3-4bb4-90c9-3ea742fc126e req-96d69f4d-42a5-42e7-bdcd-2c5c673d410f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:38.418649 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-56055e21-eba3-4bb4-90c9-3ea742fc126e req-96d69f4d-42a5-42e7-bdcd-2c5c673d410f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:38.434080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-56055e21-eba3-4bb4-90c9-3ea742fc126e req-96d69f4d-42a5-42e7-bdcd-2c5c673d410f service nova] Creating event network-vif-plugged:63488ee4-c4d9-4b58-9efa-1ce9610d00cf for instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 on hv-cinder-85426 Aug 24 03:46:38.440792 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-56055e21-eba3-4bb4-90c9-3ea742fc126e req-96d69f4d-42a5-42e7-bdcd-2c5c673d410f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039722 Aug 24 03:46:38.441741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 502/1005] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:38.500642 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:38.501379 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:38.513114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:38.513712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:38.527781 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:38.528785 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:38.529277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:38.529713 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:38.655774 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:38.656986 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:38.664863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:38.665363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:38.665806 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:38.666860 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:38.667375 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:38.667741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:38.776309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:38.791033 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f1dcaa86-9a0e-41c9-b65d-a7117c1c7bd4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1568 microversion: 2.1 time: 0.294192 Aug 24 03:46:38.805013 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 504/1006] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:38 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:38.912647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:38.913304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:38.919778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:38.920279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:38.920720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:38.921435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:38.922335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:38.922929 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.106036 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:39.118007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f4c8637e-1ce6-4d1e-87be-e13738f62e3c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1367 microversion: 2.1 time: 0.210088 Aug 24 03:46:39.118980 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 505/1007] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:38 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:39.231199 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:39.247555 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:39.249459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:39.250957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ace305c3-ac28-4f76-9c14-d3dcb158eb1e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.599587 Aug 24 03:46:39.252418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 503/1008] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:38 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:46:39.496949 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-3556223d-d733-4f0f-bf7b-0248ecdb8783 req-3d0dfaa5-db86-4b06-86d0-9ca0e619eeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6e4c30-7ab0-446f-8f76-078a95397938", "name": "network-vif-deleted", "tag": "c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:39.502092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:39.502780 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=10 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:39.508997 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3556223d-d733-4f0f-bf7b-0248ecdb8783 req-3d0dfaa5-db86-4b06-86d0-9ca0e619eeac service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.509731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3556223d-d733-4f0f-bf7b-0248ecdb8783 req-3d0dfaa5-db86-4b06-86d0-9ca0e619eeac service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.510759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3556223d-d733-4f0f-bf7b-0248ecdb8783 req-3d0dfaa5-db86-4b06-86d0-9ca0e619eeac service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.523307 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-3556223d-d733-4f0f-bf7b-0248ecdb8783 req-3d0dfaa5-db86-4b06-86d0-9ca0e619eeac service nova] Creating event network-vif-deleted:c63fc0ab-9506-4f48-a30e-7a6c2e8ebc27 for instance dc6e4c30-7ab0-446f-8f76-078a95397938 on hv-cinder-85426 Aug 24 03:46:39.528417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-3556223d-d733-4f0f-bf7b-0248ecdb8783 req-3d0dfaa5-db86-4b06-86d0-9ca0e619eeac service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035808 Aug 24 03:46:39.529233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 506/1009] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:39.823887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:39.825603 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:39.827663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:39.836865 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.837483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.838609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.839386 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:39.839902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:39.840392 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:39.919533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:39.929040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-333f397f-e93e-4b29-8d18-f9c8d19905f4 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1219 microversion: 2.1 time: 0.109583 Aug 24 03:46:39.930514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 504/1010] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:39 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:40.139973 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.141241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:40.148103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.148583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.149014 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.149695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.150142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.151169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.274700 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.275229 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:40.282775 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.283259 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.283694 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.284395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.284847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.285263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.311045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:40.320028 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7c11d20a-a594-4e00-93a4-2d101138c67e tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1367 microversion: 2.1 time: 0.184123 Aug 24 03:46:40.321902 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 507/1011] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:40.446541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:40.455773 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:40.457319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:40.458932 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8db1f1ca-84de-4d0f-bbe7-45c8b634d9fd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.187904 Aug 24 03:46:40.460731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 505/1012] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:40.956275 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:40.957741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:40.967459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:40.969450 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.970833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.971281 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:40.972191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:40.972813 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:40.973531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.057759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:41.061029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:41.068456 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-eb620276-b27f-4772-8bea-06c334fd9c2d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1219 microversion: 2.1 time: 0.119442 Aug 24 03:46:41.069054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 508/1013] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:40 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:41.343379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:41.343379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:41.346281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:41.351607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.352397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.353076 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.354664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.355381 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.356025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.494790 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:41.496615 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:41.505916 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.506537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.506975 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.526930 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.527845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.528298 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.541146 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:41.549699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-eeb16f0e-f9f8-4952-88df-797c6594ea49 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1556 microversion: 2.1 time: 0.211673 Aug 24 03:46:41.578776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 506/1014] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:41 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:41.584564 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:41.585274 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:41.605244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.606227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.606807 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.607667 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:41.608233 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:41.609183 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:41.768914 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-596dd0d7-f165-45d4-a864-243534a5091b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188814 Aug 24 03:46:41.769854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 507/1015] 10.222.0.91 () {58 vars in 1275 bytes} [Wed Aug 24 03:46:41 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:42.095427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:42.099033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:42.113303 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:42.114764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:42.118034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:42.119068 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:42.120224 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:42.124930 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:42.128882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:42.135871 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:42.140047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:42.143407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c5c5aced-b271-4489-ad84-c80a1b30e801 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.655077 Aug 24 03:46:42.145223 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 509/1016] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:41 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:42.197971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:42.199669 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:42.200057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:42.200521 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.objects.instance [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lazy-loading 'fault' on Instance uuid dc6e4c30-7ab0-446f-8f76-078a95397938 {{(pid=127260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:46:42.272633 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c89aa8c55042e7af5452f1a94318a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4ed4d70a074b97acf12130e4b00bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:42.285021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a23c84e0-6e2a-4f6d-bf42-04e09e09cce9 tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 200 len: 1224 microversion: 2.1 time: 0.198373 Aug 24 03:46:42.286738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 508/1017] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:42 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 1224 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:43.073367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-b3cbdb0c-f23c-4a99-a68b-1ac6cd8c381f req-11ccd50a-0725-4702-bb27-353f8f8f7e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0fe121-6b91-46d7-a9f5-b45d32d48d86", "tag": "63488ee4-c4d9-4b58-9efa-1ce9610d00cf"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:43.127440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b3cbdb0c-f23c-4a99-a68b-1ac6cd8c381f req-11ccd50a-0725-4702-bb27-353f8f8f7e42 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.130446 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b3cbdb0c-f23c-4a99-a68b-1ac6cd8c381f req-11ccd50a-0725-4702-bb27-353f8f8f7e42 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.133966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b3cbdb0c-f23c-4a99-a68b-1ac6cd8c381f req-11ccd50a-0725-4702-bb27-353f8f8f7e42 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.153441 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-b3cbdb0c-f23c-4a99-a68b-1ac6cd8c381f req-11ccd50a-0725-4702-bb27-353f8f8f7e42 service nova] Creating event network-changed:63488ee4-c4d9-4b58-9efa-1ce9610d00cf for instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 on hv-cinder-85426 Aug 24 03:46:43.159725 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-b3cbdb0c-f23c-4a99-a68b-1ac6cd8c381f req-11ccd50a-0725-4702-bb27-353f8f8f7e42 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089627 Aug 24 03:46:43.160333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 510/1018] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:43.311855 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:43.313638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] [instance: dc6e4c30-7ab0-446f-8f76-078a95397938] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:43.337759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.341364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.341956 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.346026 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.346911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.347423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.378240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] HTTP exception thrown: Instance dc6e4c30-7ab0-446f-8f76-078a95397938 could not be found. Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Request method failure captured: Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 HTTP/1.1 Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZ0_HmFF3IavEXHpLoVFhThLvzxfeXQgfd2NjPoj0mdMzwat1dWKRwz6cGbKRxmKyvtk07TNkivBMbQwU_xun6LWp_wXwkWQUs7d7DdpribOhjyKGkBQ9cJZvs2lo-xaf6q2nKZehigKS_OJRsEku6WjHvIkDrnSehrJ1HoTbL0ni1A Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: cc4ed4d70a074b97acf12130e4b00bcb Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-TestShelveInstance-74111230 Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:46:43.383070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_cc4ed4d70a074b97acf12130e4b00bcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cc4ed4d70a074b97acf12130e4b00bcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/cc4ed4d70a074b97acf12130e4b00bcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/cc4ed4d70a074b97acf12130e4b00bcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-TestShelveInstance-74111230 Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: cc4ed4d70a074b97acf12130e4b00bcb Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-TestShelveInstance-74111230 Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-TestShelveInstance-74111230-project Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: c0c89aa8c55042e7af5452f1a94318a9 Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-TestShelveInstance-74111230-project Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance dc6e4c30-7ab0-446f-8f76-078a95397938 could not be found. Aug 24 03:46:43.384531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': 'dc6e4c30-7ab0-446f-8f76-078a95397938'} Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6e4c30-7ab0-446f-8f76-078a95397938 could not be found. Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:43.385888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6e4c30-7ab0-446f-8f76-078a95397938 could not be found. Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6e4c30-7ab0-446f-8f76-078a95397938 could not be found. Aug 24 03:46:43.387358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:46:43.388891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Returning 404 to user: Instance dc6e4c30-7ab0-446f-8f76-078a95397938 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:43.388891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-228cdf74-8749-4033-829c-caa66cafdf5a tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938" status: 404 len: 111 microversion: 2.1 time: 0.082706 Aug 24 03:46:43.405928 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 511/1019] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:43 2022] GET /compute/v2.1/servers/dc6e4c30-7ab0-446f-8f76-078a95397938 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:43.501106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:43.502513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:43.510719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.512154 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.512764 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.513652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:43.514823 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:43.515291 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:43.634501 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-10766b54-22f3-4d76-9158-a62d18d50a9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] Calling method '.version_select at 0x7f077f7c9820>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:43.671525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-10766b54-22f3-4d76-9158-a62d18d50a9d tempest-TestShelveInstance-74111230 tempest-TestShelveInstance-74111230-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-169979743" status: 202 len: 0 microversion: 2.1 time: 0.040932 Aug 24 03:46:43.672720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 512/1020] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-169979743 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:46:43.875015 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:43.892755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:43.894939 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:43.895734 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9e81cf6c-929b-48cf-89bf-516c8f485bb6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.725934 Aug 24 03:46:43.919613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 509/1021] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:43 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:44.934066 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:44.935553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:44.943734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:44.944501 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:44.945412 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:44.946363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:44.948205 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:44.948870 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:45.194515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:45.204945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:45.206784 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:45.208152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3271432c-b744-4fd2-9ef3-659b6d5dce8f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.278063 Aug 24 03:46:45.208826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 513/1022] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:44 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:46.231822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:46.232683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:46.239627 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:46.241231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:46.241914 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:46.242916 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:46.243594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:46.244773 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:46.484209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:46.495940 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:46.498170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:46.500185 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-eb77bc88-81f9-491c-9bc4-8ad313f06937 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.272581 Aug 24 03:46:46.501653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 510/1023] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:46 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:47.530163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:47.534750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:47.549389 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:47.550094 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:47.550555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:47.556489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:47.557721 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:47.560203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:47.824155 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:47.847904 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:47.850925 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:47.856798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e6e51f59-87ed-4e80-8799-821504494322 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.331028 Aug 24 03:46:47.867457 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 514/1024] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:47 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:48.889366 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:48.890895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:48.897824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:48.898648 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:48.899292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:48.900044 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:48.900506 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:48.901037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:49.145618 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:49.155501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:49.157606 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:49.159013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a6ff6778-4bd4-4359-93cf-543a2e7943d8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.273871 Aug 24 03:46:49.160418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 511/1025] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:48 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:50.184076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:50.184746 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:50.192297 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:50.192783 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:50.193228 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:50.193926 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:50.194417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:50.195044 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:50.329927 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:50.339154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:50.340775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:50.342047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-23fd5e4a-177b-4298-8736-dafc2a122dda tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1739 microversion: 2.20 time: 0.162675 Aug 24 03:46:50.346924 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 515/1026] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:50 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:51.371609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:51.372393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:51.382955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:51.383676 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:51.384351 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:51.388043 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:51.403740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:51.404377 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:52.008455 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:52.018451 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:52.019960 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:52.021345 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6584d23c-f2fc-4330-a661-29911bbf116c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1721 microversion: 2.20 time: 0.655445 Aug 24 03:46:52.022128 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 512/1027] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:51 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1721 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:53.044974 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:53.045742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:53.052675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:53.053154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:53.053588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:53.054316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:53.054767 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:53.055183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:53.221132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:53.230858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:53.232404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:53.234521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5210d3e1-4bd1-4d2d-a38b-2de140f3338b tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1721 microversion: 2.20 time: 0.192645 Aug 24 03:46:53.234521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 516/1028] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:53 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:54.256773 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:54.257536 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:54.264811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.265303 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.265752 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.266490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.266949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.267379 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.379121 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-dcf00f9e-1e8a-4fbc-8ab1-d556fdbf3120 req-07ba0ea6-def5-41a3-a1ff-8135c20b71c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684ce0ff-fd32-480d-ba7c-07d564e2a702", "name": "network-vif-unplugged", "status": "completed", "tag": "6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:54.389072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-dcf00f9e-1e8a-4fbc-8ab1-d556fdbf3120 req-07ba0ea6-def5-41a3-a1ff-8135c20b71c8 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.389558 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-dcf00f9e-1e8a-4fbc-8ab1-d556fdbf3120 req-07ba0ea6-def5-41a3-a1ff-8135c20b71c8 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.389991 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-dcf00f9e-1e8a-4fbc-8ab1-d556fdbf3120 req-07ba0ea6-def5-41a3-a1ff-8135c20b71c8 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.404567 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-dcf00f9e-1e8a-4fbc-8ab1-d556fdbf3120 req-07ba0ea6-def5-41a3-a1ff-8135c20b71c8 service nova] Creating event network-vif-unplugged:6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf for instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 on hv-cinder-85426 Aug 24 03:46:54.410007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-dcf00f9e-1e8a-4fbc-8ab1-d556fdbf3120 req-07ba0ea6-def5-41a3-a1ff-8135c20b71c8 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035233 Aug 24 03:46:54.411175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 517/1029] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:54.417975 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:54.421477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=100 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:54.427471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:54.429183 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:54.430382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-98ca6346-7c47-40d5-a357-71b012a35257 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1724 microversion: 2.20 time: 0.177647 Aug 24 03:46:54.430944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 513/1030] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:54 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:54.454729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189e05f3-3da3-4e39-821f-8f91054cec44"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:54.457182 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:54.463380 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.463852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.464282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.464970 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.465418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.465836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.772626 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e504b02d-9dc3-4f61-b1c9-68de6a95709e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322408 Aug 24 03:46:54.773144 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 518/1031] 10.222.0.91 () {62 vars in 1364 bytes} [Wed Aug 24 03:46:54 2022] POST /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:46:54.902147 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:54.902692 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:54.908652 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.909142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.909574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:54.910299 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:54.910749 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:54.911169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.183425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2c689e08-88e7-42e9-8751-028f23acc1ce tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/os-volume_attachments/189e05f3-3da3-4e39-821f-8f91054cec44" status: 202 len: 0 microversion: 2.20 time: 0.285651 Aug 24 03:46:55.184130 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 514/1032] 10.222.0.91 () {60 vars in 1457 bytes} [Wed Aug 24 03:46:54 2022] DELETE /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/os-volume_attachments/189e05f3-3da3-4e39-821f-8f91054cec44 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:46:55.244678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:55.245265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:55.251168 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:55.251640 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:55.252066 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.252742 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:55.253187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:55.253604 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.297487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127259) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:46:55.362959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0836d3de-2607-466b-a7ee-614f92b8ea6d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "POST /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/action" status: 202 len: 0 microversion: 2.20 time: 0.122087 Aug 24 03:46:55.363935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 519/1033] 10.222.0.91 () {62 vars in 1319 bytes} [Wed Aug 24 03:46:55 2022] POST /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:46:55.372225 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:55.372930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:55.379284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:55.379851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:55.380368 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.381237 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:55.381663 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:55.382171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:55.550750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:55.558955 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:55.560888 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:55.562473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5230b3c0-ccf9-4a30-a045-b39a183fd55a tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1672 microversion: 2.20 time: 0.194112 Aug 24 03:46:55.564288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 515/1034] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:55 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:56.218474 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:46:56.218811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 03:46:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:46:56.588802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:56.589421 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:56.596103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:56.596596 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:56.597037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:56.597739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:56.598243 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:56.598680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:56.745466 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:56.753682 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:56.755501 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:56.757511 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-66c0a9b1-0c93-4b01-834c-dcb815522d65 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.173685 Aug 24 03:46:56.758079 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 520/1035] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:56 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:57.784194 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:57.784815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:57.791448 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:57.792170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:57.793255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:57.793978 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:57.794469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:57.794907 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:57.949560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:57.960709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:57.962248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:57.964003 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-47bd5f4d-fd77-412a-ad52-a44f7190a0e6 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.184424 Aug 24 03:46:57.964743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 516/1036] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:57 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:58.988122 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:58.989312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:58.996674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:58.997156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:58.997587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:58.998311 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:58.998773 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:58.999174 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:59.159557 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:59.168425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:59.169953 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:59.171141 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1c33f729-bc28-4622-82e9-a322eac89189 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.187518 Aug 24 03:46:59.171688 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 521/1037] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:46:58 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:00.194029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:00.194669 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:00.201700 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:00.202205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:00.202921 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:00.203332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:00.203801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:00.204209 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:00.357832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:00.366307 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:00.367750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:00.368918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ae42278a-48fe-474f-b9ec-2d8a58bee921 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.179076 Aug 24 03:47:00.369718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 517/1038] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:00 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:01.397436 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:01.402570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:01.414625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.415752 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.416197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.416900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:01.417352 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:01.417772 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:01.569645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:01.580987 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:01.582876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:01.583627 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d7cbbca9-bc3a-4dfe-96d8-f928b8cb49c5 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.195226 Aug 24 03:47:01.584433 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 522/1039] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:01 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:02.620355 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:02.621415 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:02.628047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:02.628539 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:02.628971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:02.629675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:02.630134 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:02.630585 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:02.773204 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:02.786124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:02.787936 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:02.789104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a79e9022-d619-45df-8cd4-433cafc98c95 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.173918 Aug 24 03:47:02.790412 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 518/1040] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:02 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:03.814676 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:03.815499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:03.825464 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:03.825861 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:03.826324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:03.827029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:03.827481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:03.827904 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:03.982529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:03.991466 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:03.992948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:03.994101 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ab009441-a0a4-40ac-be37-bd6951ebc14c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.184163 Aug 24 03:47:03.995238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 523/1041] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:03 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:05.020481 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:05.021133 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:05.028339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:05.028879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:05.029319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:05.030024 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:05.030511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:05.030936 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:05.192035 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:05.200979 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:05.202626 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:05.203919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3fcf2655-de01-4b6f-b299-8e48d37f7877 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.187448 Aug 24 03:47:05.204640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 519/1042] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:05 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:06.230771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:06.232032 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:06.239233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:06.239622 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:06.240064 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:06.240771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:06.241256 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:06.241908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:06.396682 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:06.401781 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:06.408081 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:06.410564 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:06.412035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ccc0f39c-069b-4cab-b8ac-d787e1ff9b14 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.187595 Aug 24 03:47:06.412591 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 524/1043] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:06 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:07.440574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:07.441710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:07.453150 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:07.453973 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:07.454744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:07.455908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:07.456406 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:07.457125 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:07.598736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:07.608393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:07.609895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:07.611090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d483f2fc-ce08-4605-91b3-d805e5736bd3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.178165 Aug 24 03:47:07.611646 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 520/1044] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:07 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:08.634685 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:08.635930 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:08.643564 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:08.644074 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:08.644516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:08.645220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:08.645675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:08.646100 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:08.792094 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:08.809700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:08.811477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:08.812646 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5b0cf7a2-880c-48aa-989a-7c0f6d4dc2e2 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.182329 Aug 24 03:47:08.813191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 525/1045] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:08 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:47:09.837042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:09.837588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:09.844592 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:09.845063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:09.845490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:09.846202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:09.846649 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:09.847069 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:09.979563 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:09.988629 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:09.990111 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:09.991332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-10c84bfb-bcf5-4f02-be98-ce5b112136cd tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.158289 Aug 24 03:47:09.991882 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 521/1046] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:09 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:11.015797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:11.016390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:11.023219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:11.023735 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:11.024178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:11.024876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:11.025336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:11.025788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:11.179333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:11.188763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:11.190568 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:11.191778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2df78879-9e7a-41b3-8008-9a79543eb92e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.179903 Aug 24 03:47:11.192325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 526/1047] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:11 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:12.215559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:12.216161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:12.218460 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=34 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:12.224019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:12.224497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:12.224926 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:12.225611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:12.226059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:12.226506 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:12.360676 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:12.368862 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:12.370425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:12.371588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e19ff913-5759-41ed-bfea-621b1e306402 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.160585 Aug 24 03:47:12.372152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 522/1048] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:12 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:13.394465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:13.395325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:13.397395 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:13.403405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:13.404011 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:13.404145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:13.404770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:13.405239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:13.405669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:13.552655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:13.565319 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:13.568162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:13.570358 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-793fb821-0279-4642-91b5-668875dd0f63 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.179583 Aug 24 03:47:13.571373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 527/1049] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:13 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:14.610570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:14.611731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:14.623480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:14.624108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:14.624736 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.625612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:14.626321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:14.627061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:14.782822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:14.793356 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:14.794916 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:14.796092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-49597149-fec0-46c6-a440-77ffefc7c7a8 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.193874 Aug 24 03:47:14.796665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 523/1050] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:14 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:47:15.819739 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:15.820297 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:15.827370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.827853 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.828294 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.828996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:15.829660 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:15.829876 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:15.967845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:15.978543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:15.980080 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:15.981241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-94bfd7f8-5b8e-41de-8e5f-5e8dee06ee03 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.165796 Aug 24 03:47:15.981801 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 528/1051] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:15 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:16.540980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-a57204d2-d11e-46fb-a67b-35fd3a0427c8 req-82967fb2-1502-4a48-9fd8-98a08aca8cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684ce0ff-fd32-480d-ba7c-07d564e2a702", "name": "network-vif-plugged", "status": "completed", "tag": "6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:16.552507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-a57204d2-d11e-46fb-a67b-35fd3a0427c8 req-82967fb2-1502-4a48-9fd8-98a08aca8cd3 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:16.553602 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-a57204d2-d11e-46fb-a67b-35fd3a0427c8 req-82967fb2-1502-4a48-9fd8-98a08aca8cd3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:16.554044 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-a57204d2-d11e-46fb-a67b-35fd3a0427c8 req-82967fb2-1502-4a48-9fd8-98a08aca8cd3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:16.567677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-a57204d2-d11e-46fb-a67b-35fd3a0427c8 req-82967fb2-1502-4a48-9fd8-98a08aca8cd3 service nova] Creating event network-vif-plugged:6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf for instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 on hv-cinder-85426 Aug 24 03:47:16.573640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-a57204d2-d11e-46fb-a67b-35fd3a0427c8 req-82967fb2-1502-4a48-9fd8-98a08aca8cd3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035811 Aug 24 03:47:16.574554 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 524/1052] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:17.004597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:17.005310 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:17.011861 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:17.012350 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:17.012900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:17.013618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:17.014078 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:17.014559 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:17.157996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:17.167299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:17.168797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:17.169947 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5eecd5db-99e8-437f-839b-f918a5d45c6c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.169384 Aug 24 03:47:17.170538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 529/1053] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:16 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:18.193790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:18.194561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:18.202889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:18.203384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:18.203824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:18.204541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:18.204998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:18.205430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:18.344388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:18.352785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:18.354894 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:18.356063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1b299b6d-45d4-4fa1-a707-d73a406cf0d9 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1730 microversion: 2.20 time: 0.166933 Aug 24 03:47:18.356632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 525/1054] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:18 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:19.381206 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:19.381923 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:19.388961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.389438 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.389874 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.390584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:19.391034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:19.391459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:19.570163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:19.579673 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:19.581187 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:19.582400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b03b494f-1c79-4f3c-b7c0-b0bd7e10fbc7 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1717 microversion: 2.20 time: 0.205856 Aug 24 03:47:19.582961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 530/1055] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:47:19 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1717 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:47:25.337549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:25.338817 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:25.348359 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:25.348891 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:25.349451 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:25.350710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:25.351486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:25.352173 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:25.359299 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:25.392473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8217901b-7cf4-4ce6-b730-655099072d07 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/ips" status: 200 len: 145 microversion: 2.1 time: 0.061905 Aug 24 03:47:25.393056 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 526/1056] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:47:25 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/ips => generated 145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:27.647931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b31ffdfa-8b9a-4cf8-bacc-667f0bfd10f1"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:27.651783 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:27.657440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:27.657931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:27.658418 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:27.659137 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:27.659590 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:27.660025 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:27.978238 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-371952ab-058e-4953-993f-1e4fe2cd936c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333665 Aug 24 03:47:27.978765 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 531/1057] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:47:27 2022] POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:47:35.579279 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-34b849e2-d9f9-4555-9a19-6b33f2fc6a6a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:35.582338 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=9 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:35.590910 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34b849e2-d9f9-4555-9a19-6b33f2fc6a6a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.591593 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34b849e2-d9f9-4555-9a19-6b33f2fc6a6a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.592096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-34b849e2-d9f9-4555-9a19-6b33f2fc6a6a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:35.662674 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-34b849e2-d9f9-4555-9a19-6b33f2fc6a6a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Going to try to stop instance {{(pid=127260) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:47:35.712977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-34b849e2-d9f9-4555-9a19-6b33f2fc6a6a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/action" status: 202 len: 0 microversion: 2.1 time: 0.137306 Aug 24 03:47:35.714269 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 527/1058] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:47:35 2022] POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:47:35.723541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:35.724408 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:35.733127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.733661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.734385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:35.735190 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.735671 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.736849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:35.896331 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:35.906617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b3b6efab-d6ba-4456-80cd-397445bf0952 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.187208 Aug 24 03:47:35.907260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 532/1059] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:35 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:36.930322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:36.931093 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:36.938804 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:36.939293 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:36.939742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:36.940438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:36.940897 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:36.941347 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:37.083671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:37.092928 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b902d01a-e763-4030-b85c-0fbdfdfa20eb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.166829 Aug 24 03:47:37.093511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 528/1060] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:36 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:38.116063 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:38.116736 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:38.124211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:38.124689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:38.125121 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:38.125816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:38.126304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:38.126728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:38.268075 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:38.276819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-867eb080-f0d5-40c7-80a5-639c60687ffd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.165776 Aug 24 03:47:38.277389 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 533/1061] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:38 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:39.302777 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:39.303334 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:39.310447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:39.310944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:39.311382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:39.312236 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:39.312535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:39.312983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:39.449476 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:39.457814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-755c228a-efd6-447d-a170-4d8052685af5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.159239 Aug 24 03:47:39.458404 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 529/1062] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:39 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:40.478371 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:40.479500 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:40.485935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:40.486453 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:40.486896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:40.487587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:40.488042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:40.488466 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:40.491315 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:40.627147 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:40.635614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f54130d2-2677-45b3-8b3b-aa2653599de9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.161122 Aug 24 03:47:40.636179 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 534/1063] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:40 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:41.658794 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:41.659467 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:41.666281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.667370 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.667813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.668520 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.668977 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.669404 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.811629 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:41.820588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-fb6283d4-4705-4d78-bf4d-4df9bf485ced tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.165672 Aug 24 03:47:41.821159 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 530/1064] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:41 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:42.842695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:42.843293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:42.850240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:42.850734 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:42.851173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.851882 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:42.852342 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:42.852768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.985931 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:42.995122 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-35cca52f-7e1b-406e-a1a2-88db16c63ad3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.156291 Aug 24 03:47:42.995711 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 535/1065] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:42 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:44.016715 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:44.017321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:44.023870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:44.024350 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:44.024783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.025470 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:44.025923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:44.026387 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.168010 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:44.176459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-341a6342-e69e-4fe4-b273-160eee4755b3 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.163615 Aug 24 03:47:44.177028 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 531/1066] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:44 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:45.199952 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:45.200525 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:45.202835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=18 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:45.208353 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:45.208865 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:45.209370 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:45.210060 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:45.210539 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:45.210958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:45.353292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:45.361586 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5e89a475-9031-4445-ac26-1316799116fc tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1722 microversion: 2.1 time: 0.166136 Aug 24 03:47:45.362163 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 536/1067] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:45 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:46.385519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:46.386423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:46.393869 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.394402 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.394845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.395540 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.395998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.396423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.534013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:46.543049 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b5815012-d6ec-4bd8-80bf-e89389f487fa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1699 microversion: 2.1 time: 0.163278 Aug 24 03:47:46.543641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 532/1068] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:46 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:46.564456 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b070b705-e7ba-42f1-8503-9bf8fd674d2b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:46.571258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b070b705-e7ba-42f1-8503-9bf8fd674d2b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.571751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b070b705-e7ba-42f1-8503-9bf8fd674d2b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.572192 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b070b705-e7ba-42f1-8503-9bf8fd674d2b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.633738 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b070b705-e7ba-42f1-8503-9bf8fd674d2b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Going to try to start instance {{(pid=127259) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:47:46.677972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b070b705-e7ba-42f1-8503-9bf8fd674d2b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/action" status: 202 len: 0 microversion: 2.1 time: 0.117197 Aug 24 03:47:46.678616 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 537/1069] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:47:46 2022] POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:47:46.687275 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:46.688071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:46.694372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.694889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.695322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.695990 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.696564 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.697006 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.855516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:46.863819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2480f12d-cb0a-48f2-9686-18a20b808dc6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1708 microversion: 2.1 time: 0.180298 Aug 24 03:47:46.864386 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 533/1070] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:46 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:47.892265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:47.893086 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:47.899491 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.899969 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.900400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:47.901119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:47.901569 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:47.901990 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:48.040568 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:48.049832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9af491d0-7954-4e10-bec4-6e8fd702c402 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1708 microversion: 2.1 time: 0.162204 Aug 24 03:47:48.050621 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 538/1071] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:47 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:49.075516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:49.076154 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:49.082860 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:49.083338 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:49.083765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:49.084446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:49.084893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:49.085310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:49.216400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:49.224800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d7f9d6e6-885f-4684-a269-04f95dc7ac0d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1712 microversion: 2.1 time: 0.153605 Aug 24 03:47:49.225382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 534/1072] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:49 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:13.295400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=5 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:13.296130 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:13.464790 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:13.465316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:13.471864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:13.472347 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:13.472789 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:13.473484 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:13.473940 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:13.474403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:13.497884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ad4bb55c-7c44-4d26-8553-1c053b850a48 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/ips" status: 200 len: 149 microversion: 2.1 time: 0.208169 Aug 24 03:48:13.498463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 539/1073] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:48:13 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/ips => generated 149 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:14.838044 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3de458a-6955-4aaa-97dc-addf3e2836d1"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:14.840455 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:14.842599 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=16 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.843241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.849877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:14.850402 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:14.850837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:14.851537 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:14.851993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:14.852416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:15.126919 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-00cf2e25-d128-4c53-88ba-6de52b9c748f tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "POST /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292464 Aug 24 03:48:15.127549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 535/1074] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:48:14 2022] POST /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:22.750005 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:22.750576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:22.756995 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:22.757481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:22.757942 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:22.758668 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:22.759126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:22.759556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:22.840978 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lazy-loading 'services' on Instance uuid 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:48:22.911010 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6fbdd1a6-f3b8-4c67-9d90-1d57736d618b tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-volume_attachments/b3de458a-6955-4aaa-97dc-addf3e2836d1" status: 202 len: 0 microversion: 2.1 time: 0.164751 Aug 24 03:48:22.911595 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 540/1075] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:48:22 2022] DELETE /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-volume_attachments/b3de458a-6955-4aaa-97dc-addf3e2836d1 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:48:22.920680 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:22.923034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:22.930945 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:22.931435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:22.931877 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:22.932588 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:22.933040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:22.933468 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:22.964637 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-26280404-8e65-4452-970f-b9fa398b52f6 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048178 Aug 24 03:48:22.965196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 536/1076] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:48:22 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:23.978425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:23.980636 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:23.987388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:23.987872 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:23.988308 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:23.988996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:23.989447 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:23.989872 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.022206 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1e04b683-7ff1-4fcf-9635-1cf12fbf9761 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048759 Aug 24 03:48:24.022756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 541/1077] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:48:23 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:48:24.085635 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:24.086160 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:24.092705 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.093434 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.093900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.094662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.095110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.096072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.122037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:48:24.197965 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bdead273-84e0-4aee-b354-3e730534db23 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 204 len: 0 microversion: 2.1 time: 0.116555 Aug 24 03:48:24.199020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 537/1078] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:24 2022] DELETE /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:48:24.208039 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:24.208647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:24.214667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.215143 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.215567 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.216258 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:24.216708 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:24.217132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:24.348756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:24.356374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-43729b4e-5ca2-4bad-8b5c-0bffffcb51ad tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1681 microversion: 2.1 time: 0.152847 Aug 24 03:48:24.356977 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 542/1079] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:24 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:25.380441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:25.381114 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:25.387760 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:25.388246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:25.388683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:25.389380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:25.389838 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:25.390301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:25.526751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:25.535005 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f92c32f5-3cae-408d-b3c6-e4ad6ef5c8a2 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1681 microversion: 2.1 time: 0.159531 Aug 24 03:48:25.535576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 538/1080] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:25 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:26.556746 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:26.557445 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:26.564213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.564770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.565277 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.566146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.566706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.567195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.567891 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:26.570363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:26.576579 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.577163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.577567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.578153 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.578634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.579680 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.609082 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b0d3dc3d-017b-4bde-96cb-1f9c406f3d4c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044897 Aug 24 03:48:26.609934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 539/1081] 10.222.0.91 () {60 vars in 1343 bytes} [Wed Aug 24 03:48:26 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:26.673238 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:26.673728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:26.680170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.680662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.681354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.682110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.682644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.683135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.710492 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:48:26.712479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:26.721524 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-815a63e5-ee53-4b50-b84b-cc1f1f97c57a tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1681 microversion: 2.1 time: 0.168499 Aug 24 03:48:26.722945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 543/1082] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:26 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:26.796858 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2aea6d89-597d-4609-853b-47adcdf0cc98 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 204 len: 0 microversion: 2.20 time: 0.127213 Aug 24 03:48:26.797658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 540/1083] 10.222.0.91 () {60 vars in 1280 bytes} [Wed Aug 24 03:48:26 2022] DELETE /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:48:26.807105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:26.807889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:26.814076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.814779 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.815710 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.816241 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:26.817437 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:26.818113 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:26.963169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:26.972824 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:26.974385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:26.975571 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e7cc2ec6-2c60-4309-b1c6-0ccfdf8157cb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.172384 Aug 24 03:48:26.976132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 544/1084] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:26 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:27.168841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-96302611-6910-42b8-ac12-92a893c71308 req-6fd016b5-edfc-42c2-9b92-fc4a4da3b499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0fe121-6b91-46d7-a9f5-b45d32d48d86", "name": "network-vif-deleted", "tag": "63488ee4-c4d9-4b58-9efa-1ce9610d00cf"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:27.177946 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-96302611-6910-42b8-ac12-92a893c71308 req-6fd016b5-edfc-42c2-9b92-fc4a4da3b499 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:27.178493 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-96302611-6910-42b8-ac12-92a893c71308 req-6fd016b5-edfc-42c2-9b92-fc4a4da3b499 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:27.178933 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-96302611-6910-42b8-ac12-92a893c71308 req-6fd016b5-edfc-42c2-9b92-fc4a4da3b499 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:27.190281 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-96302611-6910-42b8-ac12-92a893c71308 req-6fd016b5-edfc-42c2-9b92-fc4a4da3b499 service nova] Creating event network-vif-deleted:63488ee4-c4d9-4b58-9efa-1ce9610d00cf for instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 on hv-cinder-85426 Aug 24 03:48:27.196082 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-96302611-6910-42b8-ac12-92a893c71308 req-6fd016b5-edfc-42c2-9b92-fc4a4da3b499 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031210 Aug 24 03:48:27.196673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 541/1085] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:27.744071 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:27.744689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:27.751202 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:27.751686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:27.752132 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:27.752829 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:27.753911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:27.754382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:27.820404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:27.828127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-dd57e9dd-9663-4574-98ad-3d6a2eab7214 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1614 microversion: 2.1 time: 0.087920 Aug 24 03:48:27.828701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 545/1086] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:27 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:27.850710 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:48:27.851287 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 03:48:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:48:27.999332 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:28.000027 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:28.006854 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.007382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.007893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.008658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.009108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.009531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.155900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:28.166399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:28.167895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:28.169079 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a4ec07eb-332a-49ab-bd6d-fcfceee6832c tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.174173 Aug 24 03:48:28.169845 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 542/1087] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:27 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:48:28.849476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:28.850096 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:28.857210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.857705 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.858145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.858875 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.859328 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.859751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.893161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:28.893782 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:28.894909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:28.895677 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lazy-loading 'fault' on Instance uuid 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:48:28.937053 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d9d5fd0db54ddf85e05c77dd7f6c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7c94d613f6b440bae60fc442661c671', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:28.945966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9e569540-8d60-4d9a-aa88-b02047122f75 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 200 len: 1332 microversion: 2.1 time: 0.100854 Aug 24 03:48:28.946820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 546/1088] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:28 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:29.192822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:29.193612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:29.200301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:29.200983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:29.201658 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:29.202561 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:29.203034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:29.203648 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:29.430510 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:29.438741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:29.440251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:29.441913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-93cdfc9d-9d60-4478-8836-db58c183ef55 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1723 microversion: 2.20 time: 0.253689 Aug 24 03:48:29.442920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 543/1089] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:29 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:29.967580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:29.968227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:29.975962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:29.976571 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:29.977094 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:29.978651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:29.979521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:29.980332 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.002169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 HTTP/1.1 Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:30.004836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:30.006689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '3d0fe121-6b91-46d7-a9f5-b45d32d48d86'} Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:30.007826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:30.009391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:30.012049 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:30.013234 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-409b9d62-8f49-440a-9dfb-c091b529cb7c tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 404 len: 111 microversion: 2.1 time: 0.049809 Aug 24 03:48:30.013968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 547/1090] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:29 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:30.023420 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ef222658-64dd-4eff-a2bb-60869d848802 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '.version_select at 0x7f077c4cfb80>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:30.045663 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-d062e9d7-3db4-4965-a85a-a5622ecec96d req-d23672be-daf2-4410-b7df-2c52b27f2d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684ce0ff-fd32-480d-ba7c-07d564e2a702", "name": "network-vif-deleted", "tag": "6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:30.059463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-d062e9d7-3db4-4965-a85a-a5622ecec96d req-d23672be-daf2-4410-b7df-2c52b27f2d0f service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.060050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-d062e9d7-3db4-4965-a85a-a5622ecec96d req-d23672be-daf2-4410-b7df-2c52b27f2d0f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.060578 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-d062e9d7-3db4-4965-a85a-a5622ecec96d req-d23672be-daf2-4410-b7df-2c52b27f2d0f service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.063779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ef222658-64dd-4eff-a2bb-60869d848802 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840348796" status: 202 len: 0 microversion: 2.1 time: 0.044971 Aug 24 03:48:30.064699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 544/1091] 10.222.0.91 () {58 vars in 1221 bytes} [Wed Aug 24 03:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840348796 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:48:30.091993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-d062e9d7-3db4-4965-a85a-a5622ecec96d req-d23672be-daf2-4410-b7df-2c52b27f2d0f service nova] Creating event network-vif-deleted:6c5df29f-9ddc-4773-9cc2-b92b6c6b9faf for instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 on hv-cinder-85426 Aug 24 03:48:30.099807 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-d062e9d7-3db4-4965-a85a-a5622ecec96d req-d23672be-daf2-4410-b7df-2c52b27f2d0f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058631 Aug 24 03:48:30.100687 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 548/1092] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:30.466004 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:30.466868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:30.474170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.474844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.475534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.476319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.476871 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.477543 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.511863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:30.512435 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:30.512946 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:30.513477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.objects.instance [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lazy-loading 'fault' on Instance uuid 684ce0ff-fd32-480d-ba7c-07d564e2a702 {{(pid=127260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:48:30.573280 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:30.585849 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:30.590530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b294c0072b740cc960bc53e1f806ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f0007a8402e4889bc8ed99a507036e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:30.591965 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8255cd4d-d1eb-4f30-a3ac-a81f010f752e tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 200 len: 1371 microversion: 2.20 time: 0.130887 Aug 24 03:48:30.593031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 545/1093] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:30 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 1371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:31.618387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.619124 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.625235 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.625706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.626134 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.626923 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.627375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.627794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.642302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] HTTP exception thrown: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Request method failure captured: Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 HTTP/1.1 Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzKLG5UtwjB48qGmmzYtljF01oSiUbW8hGkxXXJdEAlaUHPE4csWu94vh0nlIyiIHeaBvYH9K0KQ2JlhQVGKUXW_-5XdbGy0gpZiUhV0EPm7I3fWsoHa4db7duOPefcrYZd-GW614_pzUZ3GnUO3iMzwtJHJv3uQN_wke5osHDFKQo Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:31.644022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 0b294c0072b740cc960bc53e1f806ffc Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:31.645581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '684ce0ff-fd32-480d-ba7c-07d564e2a702'} Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.646422 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:31.647994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.649317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Returning 404 to user: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.649317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-600f5957-c880-4822-a977-463fd5fb356d tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 404 len: 111 microversion: 2.20 time: 0.032992 Aug 24 03:48:31.649317 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 549/1094] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:31 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:48:31.655771 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-13502b2f-e7cb-4212-bc24-22ef54db0721 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '.version_select at 0x7f077f9c1280>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.674688 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-13502b2f-e7cb-4212-bc24-22ef54db0721 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621831925" status: 204 len: 0 microversion: 2.20 time: 0.023225 Aug 24 03:48:31.675889 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 546/1095] 10.222.0.91 () {60 vars in 1262 bytes} [Wed Aug 24 03:48:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621831925 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:48:31.938481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.938985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.945135 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.945617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.946052 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.946771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.947224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.947650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.965962 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 HTTP/1.1 Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:31.969023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:31.970666 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '3d0fe121-6b91-46d7-a9f5-b45d32d48d86'} Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.971562 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:31.974034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.975377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.975377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e44243bd-3211-4aa9-94a0-015325c5c083 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 404 len: 111 microversion: 2.1 time: 0.036709 Aug 24 03:48:31.975377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 550/1096] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:31 2022] DELETE /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:31.981232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.981851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 3d0fe121-6b91-46d7-a9f5-b45d32d48d86] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:31.988637 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.989068 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.989538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:31.990308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:31.990766 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:31.991194 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:32.006337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 HTTP/1.1 Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:48:32.008029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:32.009645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '3d0fe121-6b91-46d7-a9f5-b45d32d48d86'} Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:32.010523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. Aug 24 03:48:32.011787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:32.012908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 3d0fe121-6b91-46d7-a9f5-b45d32d48d86 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:32.012908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-82a10aaf-8819-4653-9e1f-019c927dc364 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86" status: 404 len: 111 microversion: 2.1 time: 0.032116 Aug 24 03:48:32.012908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 547/1097] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:31 2022] GET /compute/v2.1/servers/3d0fe121-6b91-46d7-a9f5-b45d32d48d86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:33.159471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:33.159948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:33.166279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.166759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.167191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.167875 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.168324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.168744 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.181910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 HTTP/1.1 Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:33.183509 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.185111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': 'e94e4298-9115-41cc-9220-252b7e0781d1'} Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:33.186037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.187545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.189037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:33.189037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-428ef0f0-2d90-47ec-928f-9d961ba4c4b9 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 404 len: 111 microversion: 2.1 time: 0.029233 Aug 24 03:48:33.189037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 551/1098] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:33 2022] DELETE /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:33.193040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:33.194514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: e94e4298-9115-41cc-9220-252b7e0781d1] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:33.200890 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.201370 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.201806 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.202516 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.202971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.203391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.216893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 HTTP/1.1 Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:48:33.218446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.220034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'e94e4298-9115-41cc-9220-252b7e0781d1'} Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:33.221029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. Aug 24 03:48:33.222556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.223816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance e94e4298-9115-41cc-9220-252b7e0781d1 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:33.223816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-da7e64fc-51b7-4b74-87b0-5b34e5b9414d tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1" status: 404 len: 111 microversion: 2.1 time: 0.030525 Aug 24 03:48:33.223816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 548/1099] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:33 2022] GET /compute/v2.1/servers/e94e4298-9115-41cc-9220-252b7e0781d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:48:33.228960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:33.229459 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:33.235529 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.236050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.236494 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.237213 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.237667 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.238092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.251308 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 HTTP/1.1 Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:33.252835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.254415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '2c09002f-a0ab-4747-8932-0b86085e8785'} Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:33.255204 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.256960 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.258178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:33.258178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-038244c6-521b-4f60-b3a5-4a44732f3d96 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 404 len: 111 microversion: 2.1 time: 0.029043 Aug 24 03:48:33.258178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 552/1100] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:33 2022] DELETE /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:33.263167 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:33.263812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 2c09002f-a0ab-4747-8932-0b86085e8785] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:33.269771 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.270285 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.270725 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.271407 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.272487 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.272912 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.285872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 HTTP/1.1 Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:48:33.287469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.289354 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '2c09002f-a0ab-4747-8932-0b86085e8785'} Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:33.290390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. Aug 24 03:48:33.291876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.293260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 2c09002f-a0ab-4747-8932-0b86085e8785 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:33.293260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8eebd1f0-85c8-406e-b205-fb143a71e348 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785" status: 404 len: 111 microversion: 2.1 time: 0.029423 Aug 24 03:48:33.293260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 549/1101] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:33 2022] GET /compute/v2.1/servers/2c09002f-a0ab-4747-8932-0b86085e8785 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:33.425142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:33.425647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:33.432216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.432697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.433135 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.433821 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.434313 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.434740 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.448797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] HTTP exception thrown: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Request method failure captured: Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 HTTP/1.1 Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzKLG5UtwjB48qGmmzYtljF01oSiUbW8hGkxXXJdEAlaUHPE4csWu94vh0nlIyiIHeaBvYH9K0KQ2JlhQVGKUXW_-5XdbGy0gpZiUhV0EPm7I3fWsoHa4db7duOPefcrYZd-GW614_pzUZ3GnUO3iMzwtJHJv3uQN_wke5osHDFKQo Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:33.450365 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 0b294c0072b740cc960bc53e1f806ffc Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.451852 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '684ce0ff-fd32-480d-ba7c-07d564e2a702'} Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:33.453265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.454792 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.458387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Returning 404 to user: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:33.458387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-21c95bcc-9191-4f32-8d3d-c9e81674b6db tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 404 len: 111 microversion: 2.20 time: 0.030479 Aug 24 03:48:33.458387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 553/1102] 10.222.0.91 () {60 vars in 1280 bytes} [Wed Aug 24 03:48:33 2022] DELETE /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:48:33.461843 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:33.462498 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: 684ce0ff-fd32-480d-ba7c-07d564e2a702] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:33.468452 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.469033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.469495 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.470241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.470699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.471125 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.485562 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] HTTP exception thrown: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Request method failure captured: Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 HTTP/1.1 Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzKLG5UtwjB48qGmmzYtljF01oSiUbW8hGkxXXJdEAlaUHPE4csWu94vh0nlIyiIHeaBvYH9K0KQ2JlhQVGKUXW_-5XdbGy0gpZiUhV0EPm7I3fWsoHa4db7duOPefcrYZd-GW614_pzUZ3GnUO3iMzwtJHJv3uQN_wke5osHDFKQo Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:48:33.487123 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 0b294c0072b740cc960bc53e1f806ffc Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.488832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '684ce0ff-fd32-480d-ba7c-07d564e2a702'} Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:33.489935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. Aug 24 03:48:33.491998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:33.493427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Returning 404 to user: Instance 684ce0ff-fd32-480d-ba7c-07d564e2a702 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:33.493427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4198c0f4-ec7c-4587-9ea7-3d0d6799b1eb tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702" status: 404 len: 111 microversion: 2.20 time: 0.031673 Aug 24 03:48:33.493427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 550/1103] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:33 2022] GET /compute/v2.1/servers/684ce0ff-fd32-480d-ba7c-07d564e2a702 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:48:34.430080 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:34.430626 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:34.437136 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.437610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.438038 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.438820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.439269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.439691 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.454364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 HTTP/1.1 Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:34.455958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.457434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '88860171-756d-4701-a8e0-095fd12fa4e6'} Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:34.458339 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.459634 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.461225 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:34.461225 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ce3ed387-b499-4cee-8e36-3b1204201e41 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "DELETE /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 404 len: 111 microversion: 2.1 time: 0.031800 Aug 24 03:48:34.461225 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 554/1104] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:48:34 2022] DELETE /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:34.466080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:34.466726 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] [instance: 88860171-756d-4701-a8e0-095fd12fa4e6] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:34.473647 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.474400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.475389 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.476094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.476586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.477037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.492106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] HTTP exception thrown: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Request method failure captured: Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 HTTP/1.1 Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzOTFSncXmQzgpv6Imi6JpUBzZI__0WxDkg9gPyX4JtMFuveNALHyqeFE_TzyFiUuIcyukoMtyTEybeJBnbEYij57T_sTiypdKiNrg59I2MR8qTZwjy2iM5NGv_zrMEC7IMceU4RqOsPlkPx78zxby48T7exPZxwhe3Tp36S8vUrQo Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:48:34.493656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_c7c94d613f6b440bae60fc442661c671"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/c7c94d613f6b440bae60fc442661c671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: c7c94d613f6b440bae60fc442661c671 Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1867524161 Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: b1d9d5fd0db54ddf85e05c77dd7f6c89 Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeNegativeTest-1867524161-project Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.495321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '88860171-756d-4701-a8e0-095fd12fa4e6'} Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:34.496608 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. Aug 24 03:48:34.498083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.499601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] Returning 404 to user: Instance 88860171-756d-4701-a8e0-095fd12fa4e6 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:34.499601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a55b6a0f-8dc2-4be1-af7d-2541d4b3d114 tempest-AttachVolumeNegativeTest-1867524161 tempest-AttachVolumeNegativeTest-1867524161-project] 10.222.0.91 "GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6" status: 404 len: 111 microversion: 2.1 time: 0.032880 Aug 24 03:48:34.499601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 551/1105] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:34 2022] GET /compute/v2.1/servers/88860171-756d-4701-a8e0-095fd12fa4e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:34.633879 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:34.634574 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:34.640557 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.641125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.641751 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.642601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.643124 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.645388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.658091 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] HTTP exception thrown: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Request method failure captured: Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 HTTP/1.1 Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZzKLG5UtwjB48qGmmzYtljF01oSiUbW8hGkxXXJdEAlaUHPE4csWu94vh0nlIyiIHeaBvYH9K0KQ2JlhQVGKUXW_-5XdbGy0gpZiUhV0EPm7I3fWsoHa4db7duOPefcrYZd-GW614_pzUZ3GnUO3iMzwtJHJv3uQN_wke5osHDFKQo Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:34.659600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 0b294c0072b740cc960bc53e1f806ffc Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.661097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': 'e834164b-a670-4f2a-8322-0d968d8e6703'} Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:34.662650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.663884 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.665087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Returning 404 to user: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:34.665087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8b497eb5-68bc-4ead-a37f-179ab7c40c3f tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "DELETE /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 404 len: 111 microversion: 2.20 time: 0.031730 Aug 24 03:48:34.665087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 555/1106] 10.222.0.91 () {60 vars in 1280 bytes} [Wed Aug 24 03:48:34 2022] DELETE /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:48:34.670706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:34.671323 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] [instance: e834164b-a670-4f2a-8322-0d968d8e6703] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:34.677566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.677993 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.678506 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.679177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:34.679887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:34.680039 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:34.694366 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] HTTP exception thrown: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Request method failure captured: Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 HTTP/1.1 Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZzKLG5UtwjB48qGmmzYtljF01oSiUbW8hGkxXXJdEAlaUHPE4csWu94vh0nlIyiIHeaBvYH9K0KQ2JlhQVGKUXW_-5XdbGy0gpZiUhV0EPm7I3fWsoHa4db7duOPefcrYZd-GW614_pzUZ3GnUO3iMzwtJHJv3uQN_wke5osHDFKQo Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:48:34.695957 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/6f0007a8402e4889bc8ed99a507036e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 6f0007a8402e4889bc8ed99a507036e4 Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501049226 Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 0b294c0072b740cc960bc53e1f806ffc Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501049226-project Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.697722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'e834164b-a670-4f2a-8322-0d968d8e6703'} Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:34.698541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. Aug 24 03:48:34.699743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:34.700847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] Returning 404 to user: Instance e834164b-a670-4f2a-8322-0d968d8e6703 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:34.700847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-28f0e0af-3ee1-44b0-b6a0-127770705cc3 tempest-AttachVolumeShelveTestJSON-501049226 tempest-AttachVolumeShelveTestJSON-501049226-project] 10.222.0.91 "GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703" status: 404 len: 111 microversion: 2.20 time: 0.031233 Aug 24 03:48:34.700847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 552/1107] 10.222.0.91 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:34 2022] GET /compute/v2.1/servers/e834164b-a670-4f2a-8322-0d968d8e6703 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:48:40.721054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-725ca37a-087c-4b15-858a-507dce2cce2f tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Action: 'create', calling method: .version_select at 0x7f077fa0e820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-817783698"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:41.059576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-725ca37a-087c-4b15-858a-507dce2cce2f tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.591739 Aug 24 03:48:41.069797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 556/1108] 10.222.0.91 () {60 vars in 1155 bytes} [Wed Aug 24 03:48:40 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 603 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 03:48:41.083567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-853d6ee6-974b-404d-a6be-dcb578b3864c tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c4c2820>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:41.142405 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-853d6ee6-974b-404d-a6be-dcb578b3864c tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1" status: 200 len: 344 microversion: 2.1 time: 0.062819 Aug 24 03:48:41.148693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 553/1109] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:41 2022] GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:42.156700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1963db8d-81d3-476c-b4e4-c1e284775d97 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077f971790>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.207006 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1963db8d-81d3-476c-b4e4-c1e284775d97 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1" status: 200 len: 345 microversion: 2.1 time: 0.054615 Aug 24 03:48:42.208140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 557/1110] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:42.221307 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8013682f-50cb-46c4-a89d-69641c1e5042 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Action: 'create', calling method: .version_select at 0x7f077c00c820>, body: {"snapshot": {"volume_id": "b453b74b-78ed-4769-ac60-f3ef6e6a69e1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-891550324"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:42.386893 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8013682f-50cb-46c4-a89d-69641c1e5042 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.169627 Aug 24 03:48:42.388260 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 554/1111] 10.222.0.91 () {60 vars in 1162 bytes} [Wed Aug 24 03:48:42 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:42.400077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9752b3b9-eefe-452c-8d0d-e11df765799e tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077fa0e8b0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.437061 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9752b3b9-eefe-452c-8d0d-e11df765799e tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 200 len: 286 microversion: 2.1 time: 0.041284 Aug 24 03:48:42.437813 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 558/1112] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:42.450261 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-702892cd-48f6-4f6a-bf84-a73873410373 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c289ca0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.483737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-702892cd-48f6-4f6a-bf84-a73873410373 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037818 Aug 24 03:48:42.484326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 555/1113] 10.222.0.91 () {58 vars in 1140 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:42.496224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f1738102-7270-4764-a991-6d1be3ec759f tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077f9d0a60>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.526516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f1738102-7270-4764-a991-6d1be3ec759f tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 200 len: 286 microversion: 2.1 time: 0.034140 Aug 24 03:48:42.527088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 559/1114] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:43.540515 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7e579b47-6b87-4873-b534-d1e618828fd2 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c4cf550>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:43.580251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7e579b47-6b87-4873-b534-d1e618828fd2 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 200 len: 286 microversion: 2.1 time: 0.037219 Aug 24 03:48:43.580251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 556/1115] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:43 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:44.584991 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a4cf7689-cbb2-46f9-b5b1-3d2c9ccbb9db tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c1daaf0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:44.615924 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a4cf7689-cbb2-46f9-b5b1-3d2c9ccbb9db tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 200 len: 286 microversion: 2.1 time: 0.035411 Aug 24 03:48:44.616613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 560/1116] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:44 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:45.625829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:45.626772 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:45.630781 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-f670e989-6381-4d31-913b-b8688c1179ac tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c131af0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:45.664186 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-f670e989-6381-4d31-913b-b8688c1179ac tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 200 len: 286 microversion: 2.1 time: 0.039491 Aug 24 03:48:45.664925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 557/1117] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:45 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:46.674172 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=36 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:46.674974 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:46.679387 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-decff733-6664-4a86-b47e-fc92c51e37ba tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077f8c50d0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:46.714107 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-decff733-6664-4a86-b47e-fc92c51e37ba tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 200 len: 286 microversion: 2.1 time: 0.040748 Aug 24 03:48:46.714729 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 561/1118] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:46 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:47.727126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b7199184-8854-4a40-9edc-1eb2295de88c tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c272940>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:47.760282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b7199184-8854-4a40-9edc-1eb2295de88c tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 200 len: 287 microversion: 2.1 time: 0.037361 Aug 24 03:48:47.760852 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 558/1119] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:47 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:47.771946 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f2339c22-ebfa-47d6-a159-cb2cff04ff08 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077fa0e5e0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:47.834435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f2339c22-ebfa-47d6-a159-cb2cff04ff08 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "DELETE /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 202 len: 0 microversion: 2.1 time: 0.066267 Aug 24 03:48:47.835126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 562/1120] 10.222.0.91 () {58 vars in 1254 bytes} [Wed Aug 24 03:48:47 2022] DELETE /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:48:47.843150 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-815c7ec1-8bba-4a41-856d-e4d7e2fe282a tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c1318b0>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:47.873951 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-815c7ec1-8bba-4a41-856d-e4d7e2fe282a tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 200 len: 286 microversion: 2.1 time: 0.034563 Aug 24 03:48:47.874559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 559/1121] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:47 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:48.886999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1f0744e5-d953-4d80-a6ec-12f1c56f9d33 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077f9bf4c0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:48.913477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-1f0744e5-d953-4d80-a6ec-12f1c56f9d33 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] HTTP exception thrown: Snapshot 8adb4b34-6ad2-4268-acee-2bdc01f08167 could not be found. Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1f0744e5-d953-4d80-a6ec-12f1c56f9d33 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Request method failure captured: Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 HTTP/1.1 Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZ-YY1YzoO651lSDebaLPrm23-_eP5rZH_vaQuIaSs4YEv7XEd1eMo6CQFhueiRyWQT2UBb_nKIXkIre1-5hSqO68R5YwsXH3DAJn6NKzRRf0mjBvvsk7R9Tg7qINIbTvYaxzaLPwpjXULUTNw3WzN-e_w6GhAiHfBKwK7VgV-kO2yE Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 38912b0899834adb8988b455bdfcfd27 Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:48.915898 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_38912b0899834adb8988b455bdfcfd27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 38912b0899834adb8988b455bdfcfd27 Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-VolumesSnapshotsTestJSON-848319261-project Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 85d486bc02cb460e8007ec67b5cdb0f2 Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848319261-project Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Snapshot 8adb4b34-6ad2-4268-acee-2bdc01f08167 could not be found. Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '8adb4b34-6ad2-4268-acee-2bdc01f08167'} Aug 24 03:48:48.919393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8adb4b34-6ad2-4268-acee-2bdc01f08167 could not be found. (HTTP 404) (Request-ID: req-adbd7374-6fc7-4b9f-bb16-4dad738aa22a) Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:48.920363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:48.922955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8adb4b34-6ad2-4268-acee-2bdc01f08167 could not be found. Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 03:48:48.925291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8adb4b34-6ad2-4268-acee-2bdc01f08167 could not be found. Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8adb4b34-6ad2-4268-acee-2bdc01f08167 could not be found. Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1f0744e5-d953-4d80-a6ec-12f1c56f9d33 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Returning 404 to user: Snapshot 8adb4b34-6ad2-4268-acee-2bdc01f08167 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:48.928800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1f0744e5-d953-4d80-a6ec-12f1c56f9d33 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167" status: 404 len: 111 microversion: 2.1 time: 0.034723 Aug 24 03:48:48.931119 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 563/1122] 10.222.0.91 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:48 2022] GET /compute/v2.1/os-snapshots/8adb4b34-6ad2-4268-acee-2bdc01f08167 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:48:48.931386 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-af348520-f5ef-45e7-9810-0ba0458d7a2b tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c114670>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:48.996303 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-af348520-f5ef-45e7-9810-0ba0458d7a2b tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1" status: 202 len: 0 microversion: 2.1 time: 0.074019 Aug 24 03:48:48.996868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 560/1123] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:48:48 2022] DELETE /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:48:49.005984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f7bdb666-9a60-40e4-bc40-3eb4294a8eb7 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c1daf70>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:49.060829 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f7bdb666-9a60-40e4-bc40-3eb4294a8eb7 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1" status: 200 len: 344 microversion: 2.1 time: 0.059302 Aug 24 03:48:49.061392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 564/1124] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:49 2022] GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:50.076330 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ba86514a-a566-4abd-b572-5cb3a0c82cb8 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077fa22d30>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.117169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-ba86514a-a566-4abd-b572-5cb3a0c82cb8 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] HTTP exception thrown: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ba86514a-a566-4abd-b572-5cb3a0c82cb8 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Request method failure captured: Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 HTTP/1.1 Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ-YY1YzoO651lSDebaLPrm23-_eP5rZH_vaQuIaSs4YEv7XEd1eMo6CQFhueiRyWQT2UBb_nKIXkIre1-5hSqO68R5YwsXH3DAJn6NKzRRf0mjBvvsk7R9Tg7qINIbTvYaxzaLPwpjXULUTNw3WzN-e_w6GhAiHfBKwK7VgV-kO2yE Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 38912b0899834adb8988b455bdfcfd27 Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:48:50.119382 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_38912b0899834adb8988b455bdfcfd27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 38912b0899834adb8988b455bdfcfd27 Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesSnapshotsTestJSON-848319261-project Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 85d486bc02cb460e8007ec67b5cdb0f2 Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848319261-project Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'b453b74b-78ed-4769-ac60-f3ef6e6a69e1'} Aug 24 03:48:50.120787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. (HTTP 404) (Request-ID: req-6d5e53ad-c4d4-4e11-b6dd-608d07342d40) Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.121636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:50.123863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:48:50.125952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ba86514a-a566-4abd-b572-5cb3a0c82cb8 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Returning 404 to user: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ba86514a-a566-4abd-b572-5cb3a0c82cb8 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1" status: 404 len: 109 microversion: 2.1 time: 0.049198 Aug 24 03:48:50.128425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 561/1125] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:50 2022] GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:50.136301 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-56592ca0-33c2-4ca0-976f-e69cfe6b6415 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077f8c5160>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.168269 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-56592ca0-33c2-4ca0-976f-e69cfe6b6415 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] HTTP exception thrown: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-56592ca0-33c2-4ca0-976f-e69cfe6b6415 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Request method failure captured: Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 HTTP/1.1 Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZ-YY1YzoO651lSDebaLPrm23-_eP5rZH_vaQuIaSs4YEv7XEd1eMo6CQFhueiRyWQT2UBb_nKIXkIre1-5hSqO68R5YwsXH3DAJn6NKzRRf0mjBvvsk7R9Tg7qINIbTvYaxzaLPwpjXULUTNw3WzN-e_w6GhAiHfBKwK7VgV-kO2yE Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 38912b0899834adb8988b455bdfcfd27 Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:48:50.170965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_38912b0899834adb8988b455bdfcfd27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 38912b0899834adb8988b455bdfcfd27 Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-VolumesSnapshotsTestJSON-848319261-project Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 85d486bc02cb460e8007ec67b5cdb0f2 Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848319261-project Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': 'b453b74b-78ed-4769-ac60-f3ef6e6a69e1'} Aug 24 03:48:50.172623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. (HTTP 404) (Request-ID: req-495a2980-9095-473a-bf5a-db1deac63b0d) Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.173709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:48:50.175198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:48:50.180504 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-56592ca0-33c2-4ca0-976f-e69cfe6b6415 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Returning 404 to user: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-56592ca0-33c2-4ca0-976f-e69cfe6b6415 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1" status: 404 len: 109 microversion: 2.1 time: 0.043515 Aug 24 03:48:50.182247 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 565/1126] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:48:50 2022] DELETE /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:50.184707 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ddd6e440-2e7f-4971-832d-5cf7e6f0f9d0 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Calling method '.version_select at 0x7f077c114f70>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.213793 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-ddd6e440-2e7f-4971-832d-5cf7e6f0f9d0 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] HTTP exception thrown: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ddd6e440-2e7f-4971-832d-5cf7e6f0f9d0 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Request method failure captured: Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 HTTP/1.1 Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ-YY1YzoO651lSDebaLPrm23-_eP5rZH_vaQuIaSs4YEv7XEd1eMo6CQFhueiRyWQT2UBb_nKIXkIre1-5hSqO68R5YwsXH3DAJn6NKzRRf0mjBvvsk7R9Tg7qINIbTvYaxzaLPwpjXULUTNw3WzN-e_w6GhAiHfBKwK7VgV-kO2yE Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 38912b0899834adb8988b455bdfcfd27 Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:48:50.215908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_38912b0899834adb8988b455bdfcfd27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/38912b0899834adb8988b455bdfcfd27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 38912b0899834adb8988b455bdfcfd27 Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-848319261 Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesSnapshotsTestJSON-848319261-project Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 85d486bc02cb460e8007ec67b5cdb0f2 Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesSnapshotsTestJSON-848319261-project Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'b453b74b-78ed-4769-ac60-f3ef6e6a69e1'} Aug 24 03:48:50.217276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. (HTTP 404) (Request-ID: req-b7f2b4a9-d568-4271-bdba-18378ba205f2) Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.218097 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:50.219656 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:48:50.221594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ddd6e440-2e7f-4971-832d-5cf7e6f0f9d0 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] Returning 404 to user: Volume b453b74b-78ed-4769-ac60-f3ef6e6a69e1 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ddd6e440-2e7f-4971-832d-5cf7e6f0f9d0 tempest-VolumesSnapshotsTestJSON-848319261 tempest-VolumesSnapshotsTestJSON-848319261-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1" status: 404 len: 109 microversion: 2.1 time: 0.036401 Aug 24 03:48:50.223289 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 562/1127] 10.222.0.91 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:50 2022] GET /compute/v2.1/os-volumes/b453b74b-78ed-4769-ac60-f3ef6e6a69e1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:51.689460 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-216974236", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "networks": [{"uuid": "a1a2b135-9496-40fd-bffd-baaaacff4ee0"}]}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:51.745513 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] validate_networks() for [('a1a2b135-9496-40fd-bffd-baaaacff4ee0', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:52.124448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:52.124878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:52.125355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:52.125768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:52.126304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:52.136984 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.137635 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.138080 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.138832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.139289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.139720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.157344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Getting quotas for project 9b17dad9df1840cc816875bcc42f1706. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:52.161444 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Getting quotas for user bec33f84fef94b56ab0e1639bb8f9b14 and project 9b17dad9df1840cc816875bcc42f1706. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:52.173672 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:52.176008 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:52.231219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b309d738-8315-4841-8e57-6e9d04d39a67 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546689 Aug 24 03:48:52.231737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 566/1128] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:52.243391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ae42f098-38c5-489b-9c4f-901ff8693adf tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:52.244019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ae42f098-38c5-489b-9c4f-901ff8693adf tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:52.308632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ae42f098-38c5-489b-9c4f-901ff8693adf tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:52.316833 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ae42f098-38c5-489b-9c4f-901ff8693adf tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1218 microversion: 2.1 time: 0.078199 Aug 24 03:48:52.317898 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 563/1129] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:52 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:53.338738 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.339286 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.345969 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.346492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.347029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.347732 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.348186 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.348609 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.410706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.418972 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d741798f-60bb-40ad-b235-52302777e9d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1270 microversion: 2.1 time: 0.084767 Aug 24 03:48:53.419546 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 567/1130] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.442754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.443392 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.450094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.450616 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.451051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.451750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.452212 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.452634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.657369 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.665092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8ab0976d-ba5b-433b-be34-a49bffc91ccb tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.226386 Aug 24 03:48:54.665664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 564/1131] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.864549 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-a5631a35-2fbc-45be-af9e-02d7dd3ea568 req-ba9f9507-7896-40c9-9280-0b1923b8fbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91cca21-0c01-45e5-8e6a-0982cd17a172", "tag": "e82e362e-eb32-402d-a742-702f60495e2c"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:54.877664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a5631a35-2fbc-45be-af9e-02d7dd3ea568 req-ba9f9507-7896-40c9-9280-0b1923b8fbdd service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.878281 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a5631a35-2fbc-45be-af9e-02d7dd3ea568 req-ba9f9507-7896-40c9-9280-0b1923b8fbdd service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.878803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-a5631a35-2fbc-45be-af9e-02d7dd3ea568 req-ba9f9507-7896-40c9-9280-0b1923b8fbdd service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.890822 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-a5631a35-2fbc-45be-af9e-02d7dd3ea568 req-ba9f9507-7896-40c9-9280-0b1923b8fbdd service nova] Creating event network-changed:e82e362e-eb32-402d-a742-702f60495e2c for instance b91cca21-0c01-45e5-8e6a-0982cd17a172 on hv-cinder-85426 Aug 24 03:48:54.895688 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-a5631a35-2fbc-45be-af9e-02d7dd3ea568 req-ba9f9507-7896-40c9-9280-0b1923b8fbdd service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034851 Aug 24 03:48:54.896282 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 568/1132] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:55.685616 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:55.686245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:55.692512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.693012 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.693447 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.694162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.694695 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.695381 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.825680 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.833290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c839d3f7-372a-433b-a7ae-0a0e17c80610 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.151583 Aug 24 03:48:55.833844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 565/1133] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:56.855375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.856035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:56.862150 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.862664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.863106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.863796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.864254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.864682 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.997991 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.005939 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e28b6c97-216a-46f0-b0d3-7d3d23f352a2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.155346 Aug 24 03:48:57.006570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 569/1134] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:58.026385 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:58.027008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:58.033362 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.033852 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.034328 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.035029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.035484 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.035937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.169115 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:58.176730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-329acda6-7583-4e3f-9523-20ce04255e4d tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.154230 Aug 24 03:48:58.177295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 566/1135] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:58 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:59.197816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:59.198407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:59.204886 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.205363 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.205799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.206531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.206985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.207417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.343364 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.351240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-97024f0c-7d14-4857-8edd-2aee115421cc tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.158268 Aug 24 03:48:59.351816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 570/1136] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:59 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:59.862158 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:59.862712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:59.870770 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.871400 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.871879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.872602 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.873218 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.873671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.963207 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.objects.instance [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lazy-loading 'services' on Instance uuid b9453748-a38e-47eb-a18d-321371e80d31 {{(pid=127260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:00.039565 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5e4e4199-2784-4790-a97b-6abe77cf467f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/os-volume_attachments/b31ffdfa-8b9a-4cf8-bacc-667f0bfd10f1" status: 202 len: 0 microversion: 2.1 time: 0.182151 Aug 24 03:49:00.040232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 567/1137] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:48:59 2022] DELETE /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/os-volume_attachments/b31ffdfa-8b9a-4cf8-bacc-667f0bfd10f1 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:49:00.371804 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.372417 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.378827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.379306 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.379744 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.380434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.380887 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.381315 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.515324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.523012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b3797a74-f95b-4e25-a95d-dadd94e2a729 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.155085 Aug 24 03:49:00.523576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 571/1138] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:01.545892 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.546479 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.555541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.556040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.556477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.557434 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.558031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.558570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.769282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:01.778293 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b764284e-5ae7-4e19-9688-f0eacd27c496 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.237467 Aug 24 03:49:01.778862 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 568/1139] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:02.799472 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:02.800087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:02.802895 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:02.804480 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:02.811016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.811823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.812565 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.813386 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.813886 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.814361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.949152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:02.956856 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f29b4425-90a6-477f-9291-45a3f2be9075 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.162025 Aug 24 03:49:02.957429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 572/1140] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:02 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:03.290684 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9802e4df-4043-4f2b-ac4e-bc2852857729 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:03.292750 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:03.298671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9802e4df-4043-4f2b-ac4e-bc2852857729 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.299164 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9802e4df-4043-4f2b-ac4e-bc2852857729 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.299606 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9802e4df-4043-4f2b-ac4e-bc2852857729 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.322665 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9802e4df-4043-4f2b-ac4e-bc2852857729 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Going to try to stop instance {{(pid=127260) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:49:03.364118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9802e4df-4043-4f2b-ac4e-bc2852857729 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/action" status: 202 len: 0 microversion: 2.1 time: 0.077906 Aug 24 03:49:03.364738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 569/1141] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:49:03 2022] POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:49:03.373374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:03.374087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:03.383018 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.384066 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.384545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.385506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.386009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.386476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.542531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:03.560887 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a1302e9b-da5f-48cf-a671-3919e1bd1f31 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.191214 Aug 24 03:49:03.561661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 573/1142] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:03 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:03.978020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:03.979030 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:03.985330 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.985946 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.986414 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.987121 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.987581 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.988010 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.171227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.182472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-672dc7bb-c174-4904-8d74-04f722b93997 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.209079 Aug 24 03:49:04.183337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 570/1143] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:03 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:04.582443 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:04.583304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:04.590515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.591015 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.591448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.592803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.593274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.593699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.734096 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.742654 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0ab3b6a2-be28-47c4-b9b4-c08256a284b9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.163897 Aug 24 03:49:04.743420 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 574/1144] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:04 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:05.211890 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.212497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.218535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.219664 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.220152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.221136 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.221588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.222040 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.331372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-de52ae33-84a0-4303-8844-0198821b36db req-e53ba006-7d49-4026-be7e-3ea592a8947e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91cca21-0c01-45e5-8e6a-0982cd17a172", "name": "network-vif-plugged", "status": "completed", "tag": "e82e362e-eb32-402d-a742-702f60495e2c"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:05.343155 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-de52ae33-84a0-4303-8844-0198821b36db req-e53ba006-7d49-4026-be7e-3ea592a8947e service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.343664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-de52ae33-84a0-4303-8844-0198821b36db req-e53ba006-7d49-4026-be7e-3ea592a8947e service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.344096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-de52ae33-84a0-4303-8844-0198821b36db req-e53ba006-7d49-4026-be7e-3ea592a8947e service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.359469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-de52ae33-84a0-4303-8844-0198821b36db req-e53ba006-7d49-4026-be7e-3ea592a8947e service nova] Creating event network-vif-plugged:e82e362e-eb32-402d-a742-702f60495e2c for instance b91cca21-0c01-45e5-8e6a-0982cd17a172 on hv-cinder-85426 Aug 24 03:49:05.366523 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-de52ae33-84a0-4303-8844-0198821b36db req-e53ba006-7d49-4026-be7e-3ea592a8947e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270435 Aug 24 03:49:05.367348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 571/1145] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:05.369452 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:05.378419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f90a30dd-eea7-4a15-87e5-c1794df49b68 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.170266 Aug 24 03:49:05.378854 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 575/1146] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:05.770938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.771638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.777920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.778475 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.779119 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.779839 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.780305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.780735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.944683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:05.955080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-bc3acb54-a752-4f7b-8bbf-8cdf27a6d036 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.188167 Aug 24 03:49:05.955900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 572/1147] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:06.398909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:06.400392 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:06.407413 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.407897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.408320 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.409019 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.409470 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.409888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.558845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:06.565497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c3447b8b-69de-4156-857c-26f722c3c3ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1318 microversion: 2.1 time: 0.170646 Aug 24 03:49:06.566311 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 576/1148] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:06 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:06.977639 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:06.978536 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:06.986391 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.987122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.987569 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.988466 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.989002 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.989568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.151944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.151944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-98fe0613-3b6d-44e9-9694-d8b8d78e5825 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.178707 Aug 24 03:49:07.152383 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 573/1149] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:06 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:07.586668 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:07.587286 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:07.593778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.594305 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.594741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.595419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.595870 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.596287 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.730866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.740198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b791fb33-31c3-4165-9f87-6d7bb7419a59 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1506 microversion: 2.1 time: 0.157440 Aug 24 03:49:07.741466 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 577/1150] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:07 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:08.176296 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.177450 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:08.187292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.188930 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.189791 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.191014 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.191936 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.192616 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.367640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:08.375243 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e9d6bf89-422c-48e6-a6c6-c038493ccc22 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.204931 Aug 24 03:49:08.375805 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 574/1151] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:08 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:09.397212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:09.397828 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:09.404284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.404763 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.405199 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.405896 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.406388 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.406815 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.554106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:09.563152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-808f1cc1-866a-444a-b327-acea1f27bd49 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.169808 Aug 24 03:49:09.564090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 578/1152] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:09 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:10.587808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:10.588403 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:10.594838 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.595321 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.596349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.596490 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.596890 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.597316 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.742262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:10.751719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b2cabbd6-9561-45ab-b623-f7ede601eda7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.168420 Aug 24 03:49:10.752758 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 575/1153] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:10 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:11.776031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:11.777059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:11.783849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:11.784335 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:11.784770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.785461 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:11.785909 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:11.786378 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.921992 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.932260 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ab54efb2-141f-4d6c-96e1-02b6e1014a15 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.160842 Aug 24 03:49:11.933084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 579/1154] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:11 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:12.959036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:12.959742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:12.967239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.967721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.968149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.968839 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.969284 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.969703 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.113054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:13.120938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-aa6dafea-c721-49df-9694-9571d4b73ed6 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.165724 Aug 24 03:49:13.121505 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 576/1155] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:12 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:14.142556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:14.143180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:14.151492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.152018 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.152472 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.153303 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.153788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.154336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.306348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:14.315926 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4744adc9-4b5c-4e9f-96cd-6e32d67c4dc8 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.177368 Aug 24 03:49:14.316547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 580/1156] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:14 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:15.339884 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:15.340486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:15.347312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.347795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.348231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.348925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.349377 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.349800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.498757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:15.507958 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5d7b7592-5391-4b7a-bb8c-7dcd69b4a685 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.171843 Aug 24 03:49:15.508538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 577/1157] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:15 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:16.529477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:16.530159 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:16.537156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.538165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.538649 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.539350 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.539836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.540265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.686273 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:16.693108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=88 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:16.700835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8ffef708-3c39-4861-be8f-dd91a8b519d7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.175564 Aug 24 03:49:16.701432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 581/1158] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:16 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:17.730948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.731645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.735582 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=33 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:17.742247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.742247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.742247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.742247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.743080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.743080 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.746509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:17.898757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.906895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-514e00a0-f068-410f-b2e6-9f6669ba73d9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.181740 Aug 24 03:49:17.907668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 578/1159] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:18.928617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:18.929823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:18.932381 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:18.938537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.939034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.939612 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.940472 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.940900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.941324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.096300 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:19.105023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-14f08261-f0fc-4118-b6a7-2ed02ec8c9a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.180307 Aug 24 03:49:19.105595 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 582/1160] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:18 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:20.129503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:20.130122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:20.137399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.137823 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.138286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.138986 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.139441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.139867 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.281840 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:20.290687 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e1b5a00e-3b02-4187-84e7-2d9130299d67 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.164985 Aug 24 03:49:20.291266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 579/1161] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:20 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:21.315180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:21.316468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:21.324397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.324786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.325328 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.326032 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.326699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.327312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.498462 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:21.508711 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ef1500ed-c570-4bdd-b124-5b6926abc721 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.197981 Aug 24 03:49:21.509224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 583/1162] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:21 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:22.530509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:22.531261 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:22.539211 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.539741 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.540237 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.541049 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.541497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.542041 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.692918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:22.702169 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3b5bb888-5be9-49fc-bf8d-e3a60e7b4ef0 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.175516 Aug 24 03:49:22.702790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 580/1163] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:22 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:23.724450 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:23.725270 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:23.736910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.736910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.736910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.736910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.737913 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.737913 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.882584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:23.890582 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5da298d7-d2ad-4558-8307-e44f7d4a94e7 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.170718 Aug 24 03:49:23.891438 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 584/1164] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:23 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:24.913042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:24.914223 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:24.920459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.920943 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.921384 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.922071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.922583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.923007 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.060735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:25.069527 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3bb04470-790a-43a0-bdf2-5fdf17fccc3f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1676 microversion: 2.1 time: 0.160513 Aug 24 03:49:25.070152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 581/1165] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:24 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:26.090412 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:26.091216 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:26.098975 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.099597 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.100095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.100883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.101346 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.101797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.252302 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:26.260041 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-680c04f4-fa20-4ce1-99f5-9f7776449d91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1653 microversion: 2.1 time: 0.173590 Aug 24 03:49:26.260603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 585/1166] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:26 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1653 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:26.280607 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ad8c66b1-10f8-421e-b7a2-b31c997565b2 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:26.287294 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad8c66b1-10f8-421e-b7a2-b31c997565b2 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.287779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad8c66b1-10f8-421e-b7a2-b31c997565b2 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.288214 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ad8c66b1-10f8-421e-b7a2-b31c997565b2 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.312054 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ad8c66b1-10f8-421e-b7a2-b31c997565b2 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Going to try to start instance {{(pid=127260) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:49:26.354290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ad8c66b1-10f8-421e-b7a2-b31c997565b2 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/action" status: 202 len: 0 microversion: 2.1 time: 0.077231 Aug 24 03:49:26.354811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 582/1167] 10.222.0.91 () {60 vars in 1278 bytes} [Wed Aug 24 03:49:26 2022] POST /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:49:26.363561 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:26.364233 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:26.371055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.371539 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.372183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.372844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.373390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.373816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.521817 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:26.531054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5a3312c2-5613-40e2-bac4-105a3182060d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1662 microversion: 2.1 time: 0.171543 Aug 24 03:49:26.546393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 586/1168] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:26 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:27.552258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:27.553020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:27.559673 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.560326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.560784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.561507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.561967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.562530 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.703393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:27.711439 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-025020e6-7bbb-4975-8c66-9ed29f27c5a1 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1662 microversion: 2.1 time: 0.163825 Aug 24 03:49:27.712040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 583/1169] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:27 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:28.732397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:28.733310 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:28.739790 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.740279 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.740701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.741400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.741905 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.742397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.890627 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:28.901376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9a3a97fc-6e73-4a01-8540-1242ab39a7b5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1666 microversion: 2.1 time: 0.170079 Aug 24 03:49:28.901376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 587/1170] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:28 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1666 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:38.893398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f30aeb37-5451-4f4d-b27e-3f644d233132", "device": "/dev/sdb"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:38.896272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:38.898880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=11 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:38.899541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:38.905225 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:38.905721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:38.906154 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:38.906874 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:38.907331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:38.907786 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:41.610101 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8769c4fb-83dd-4f15-b891-89262dabb9e2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "POST /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.720429 Aug 24 03:49:41.611000 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 584/1171] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:49:38 2022] POST /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172/os-volume_attachments => generated 194 bytes in 2722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:16.228129 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:50:16.228833 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 03:50:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:50:19.803224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:19.803726 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:19.805891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=11 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:19.806550 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=36 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:19.813105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:19.813607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:19.814037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:19.814750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:19.815197 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:19.815615 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:19.895378 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lazy-loading 'services' on Instance uuid b91cca21-0c01-45e5-8e6a-0982cd17a172 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:50:19.966923 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b021797f-276b-466c-a125-e337e5c02d32 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172/os-volume_attachments/f30aeb37-5451-4f4d-b27e-3f644d233132" status: 202 len: 0 microversion: 2.1 time: 0.167501 Aug 24 03:50:19.967569 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 588/1172] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:50:19 2022] DELETE /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172/os-volume_attachments/f30aeb37-5451-4f4d-b27e-3f644d233132 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:50:22.154061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:22.154972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:22.160085 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:22.160814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:22.170952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.171570 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.172200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:22.172872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.173331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.173918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:22.199689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:50:22.281709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ed182430-6fd6-431c-bf24-ba0275102d08 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 204 len: 0 microversion: 2.1 time: 0.128844 Aug 24 03:50:22.282614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 585/1173] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:50:22 2022] DELETE /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:50:22.291872 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:22.292576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:22.298838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.299330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.299775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:22.300475 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.300928 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.301356 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:22.455409 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:22.463440 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e2d1e615-69af-4c9f-9d26-877182d2bcd4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1512 microversion: 2.1 time: 0.176296 Aug 24 03:50:22.464291 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 589/1174] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:22 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:23.485081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:23.485858 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:23.492198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:23.492797 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:23.493342 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.494089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:23.494695 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:23.495193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.628972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:23.637140 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-18a9ad3e-de5d-4fb5-b4e7-9df0ad0a8798 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1512 microversion: 2.1 time: 0.156746 Aug 24 03:50:23.638373 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 586/1175] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:23 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:24.659892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:24.660536 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:24.667541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:24.668026 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:24.668838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:24.670252 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:24.671057 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:24.671494 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:24.820818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:24.833532 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-075f98ad-896a-4ca6-a1db-18a1705ba173 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1512 microversion: 2.1 time: 0.177885 Aug 24 03:50:24.834122 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 590/1176] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:24 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:25.448583 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-92cfad46-9fd4-44be-92e6-c78a9b9c78e5 req-1fe61f79-aff2-4b55-834d-42944de99c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91cca21-0c01-45e5-8e6a-0982cd17a172", "name": "network-vif-deleted", "tag": "e82e362e-eb32-402d-a742-702f60495e2c"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:25.463282 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-92cfad46-9fd4-44be-92e6-c78a9b9c78e5 req-1fe61f79-aff2-4b55-834d-42944de99c92 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.466917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-92cfad46-9fd4-44be-92e6-c78a9b9c78e5 req-1fe61f79-aff2-4b55-834d-42944de99c92 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.467752 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-92cfad46-9fd4-44be-92e6-c78a9b9c78e5 req-1fe61f79-aff2-4b55-834d-42944de99c92 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.482019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-92cfad46-9fd4-44be-92e6-c78a9b9c78e5 req-1fe61f79-aff2-4b55-834d-42944de99c92 service nova] Creating event network-vif-deleted:e82e362e-eb32-402d-a742-702f60495e2c for instance b91cca21-0c01-45e5-8e6a-0982cd17a172 on hv-cinder-85426 Aug 24 03:50:25.487046 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-92cfad46-9fd4-44be-92e6-c78a9b9c78e5 req-1fe61f79-aff2-4b55-834d-42944de99c92 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267609 Aug 24 03:50:25.487972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 587/1177] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:50:25.857220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:25.857903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:25.868684 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.869180 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.869616 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.871940 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.872531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.874430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.911115 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.911832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.912530 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.913160 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lazy-loading 'fault' on Instance uuid b91cca21-0c01-45e5-8e6a-0982cd17a172 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:50:25.960045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:25.970856 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-f8817a18-4777-4f58-aa4e-5b2289aec906 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 200 len: 1308 microversion: 2.1 time: 0.117954 Aug 24 03:50:25.971437 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 591/1178] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:25 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:26.993193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:26.993895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: b91cca21-0c01-45e5-8e6a-0982cd17a172] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:27.000021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.000509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.000947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.001643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.002156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.002706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.016138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] HTTP exception thrown: Instance b91cca21-0c01-45e5-8e6a-0982cd17a172 could not be found. Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Request method failure captured: Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 HTTP/1.1 Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ-iTabtBtrtc9K0ukr7f7px_4e8q8dWYzsxEQ5gYjOZiwh0WCV0zkZa27xXwwrBexU6yO0vco9XHZ0_VuwjpZKqst6fZ3xuJZtoRwRIXTehpTviAnWQ3ewmFc5w6MQwcq1YJKwnnrPba4Ihe_xMJ5o0Cv45v4lrR7ywC-O5X2DV2P0 Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 9b17dad9df1840cc816875bcc42f1706 Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-VolumesSnapshotTestJSON-551811160 Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:50:27.017735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9b17dad9df1840cc816875bcc42f1706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9b17dad9df1840cc816875bcc42f1706"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9b17dad9df1840cc816875bcc42f1706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9b17dad9df1840cc816875bcc42f1706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-VolumesSnapshotTestJSON-551811160 Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 9b17dad9df1840cc816875bcc42f1706 Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-551811160 Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-VolumesSnapshotTestJSON-551811160-project Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: bec33f84fef94b56ab0e1639bb8f9b14 Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-VolumesSnapshotTestJSON-551811160-project Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance b91cca21-0c01-45e5-8e6a-0982cd17a172 could not be found. Aug 24 03:50:27.019591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'b91cca21-0c01-45e5-8e6a-0982cd17a172'} Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91cca21-0c01-45e5-8e6a-0982cd17a172 could not be found. Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:27.020508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91cca21-0c01-45e5-8e6a-0982cd17a172 could not be found. Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91cca21-0c01-45e5-8e6a-0982cd17a172 could not be found. Aug 24 03:50:27.022124 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:50:27.024171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Returning 404 to user: Instance b91cca21-0c01-45e5-8e6a-0982cd17a172 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:27.024171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-94a58b70-44a5-4d03-a1bb-fda04e692b7e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172" status: 404 len: 111 microversion: 2.1 time: 0.030627 Aug 24 03:50:27.024171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 588/1179] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:26 2022] GET /compute/v2.1/servers/b91cca21-0c01-45e5-8e6a-0982cd17a172 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:38.039404 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1783126720", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "networks": [{"uuid": "a1a2b135-9496-40fd-bffd-baaaacff4ee0"}]}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:38.048965 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=10 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:38.049624 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:38.107267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] validate_networks() for [('a1a2b135-9496-40fd-bffd-baaaacff4ee0', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:38.608703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:38.609156 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:38.609631 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:38.610064 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:38.610505 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:38.619692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.620160 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.620593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.621857 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.622349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.622777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.640867 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Getting quotas for project 9b17dad9df1840cc816875bcc42f1706. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:38.644813 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Getting quotas for user bec33f84fef94b56ab0e1639bb8f9b14 and project 9b17dad9df1840cc816875bcc42f1706. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:38.655934 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:38.658210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:38.705281 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4f673576-008a-4179-8d51-5e1204d3c17a tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669701 Aug 24 03:50:38.705908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 592/1180] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:50:38.717519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cbeeb576-b5e9-4674-9710-6c8d7c726cc9 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:38.718907 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cbeeb576-b5e9-4674-9710-6c8d7c726cc9 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:38.723020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:38.723684 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:38.785822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-cbeeb576-b5e9-4674-9710-6c8d7c726cc9 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:38.792709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cbeeb576-b5e9-4674-9710-6c8d7c726cc9 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1219 microversion: 2.1 time: 0.079777 Aug 24 03:50:38.793278 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 589/1181] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:38 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:39.815321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:39.816709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:39.826095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:39.826648 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:39.827090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:39.828069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:39.828610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:39.829661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:39.895842 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:39.905045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8d6ca3b5-ab32-4dfc-82eb-1567089ce957 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1289 microversion: 2.1 time: 0.095809 Aug 24 03:50:39.906007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 593/1182] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:39 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:40.925880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:40.926444 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:40.935324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:40.936983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:40.936983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:40.936983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:40.939499 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:40.939499 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.166127 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:41.174112 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-980c3a04-b32f-4e14-8aa9-b9a9ec9c61b2 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1319 microversion: 2.1 time: 0.251982 Aug 24 03:50:41.174713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 590/1183] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:40 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:41.333035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-b18054c3-0f63-4fe0-aeb5-2816ce00dcd9 req-5051dbdc-a69f-4cfc-8bd4-6eb0b17349f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d78a2e7-01d7-4ffa-b904-d675025f1b80", "tag": "1d91bcaf-1cff-4092-9346-e13ae001ab18"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:41.347083 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b18054c3-0f63-4fe0-aeb5-2816ce00dcd9 req-5051dbdc-a69f-4cfc-8bd4-6eb0b17349f2 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.347851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b18054c3-0f63-4fe0-aeb5-2816ce00dcd9 req-5051dbdc-a69f-4cfc-8bd4-6eb0b17349f2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.348689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-b18054c3-0f63-4fe0-aeb5-2816ce00dcd9 req-5051dbdc-a69f-4cfc-8bd4-6eb0b17349f2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.362367 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-b18054c3-0f63-4fe0-aeb5-2816ce00dcd9 req-5051dbdc-a69f-4cfc-8bd4-6eb0b17349f2 service nova] Creating event network-changed:1d91bcaf-1cff-4092-9346-e13ae001ab18 for instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 on hv-cinder-85426 Aug 24 03:50:41.367681 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-b18054c3-0f63-4fe0-aeb5-2816ce00dcd9 req-5051dbdc-a69f-4cfc-8bd4-6eb0b17349f2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038383 Aug 24 03:50:41.368485 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 594/1184] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:42.202597 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:42.203211 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:42.209709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.210205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.210636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.211311 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.211751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.212183 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.346869 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:42.354666 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-19674332-5b62-4fed-ae27-e1a3a2642ada tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1319 microversion: 2.1 time: 0.156181 Aug 24 03:50:42.355278 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 591/1185] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:42 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:43.377670 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:43.378307 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:43.384351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.384823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.385254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.385933 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.386448 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.386878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.515031 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:43.522674 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-07a01ba9-93c3-4a27-8445-b19f4c48a118 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1319 microversion: 2.1 time: 0.149865 Aug 24 03:50:43.523229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 595/1186] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:43 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:44.547956 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:44.549083 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:44.560344 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.561176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.562220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.563488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.564105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.564870 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.032755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:45.040657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a86383c1-8abb-4fbe-9cf7-da0795f15123 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1319 microversion: 2.1 time: 0.500144 Aug 24 03:50:45.041227 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 592/1187] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:44 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:46.070600 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:46.071325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:46.080324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.080800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.081467 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.082176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.082672 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.083098 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.237181 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:46.245430 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-32bd9242-e278-4533-a45b-9e26c28d6fe5 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1319 microversion: 2.1 time: 0.179099 Aug 24 03:50:46.246737 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 596/1188] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:46 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:47.267923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:47.268829 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:47.275317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.275802 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.276240 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.276984 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.277434 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.277852 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.438264 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:47.446529 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-8163d24f-9887-4765-8b2f-7e3f5da2d6ca tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1319 microversion: 2.1 time: 0.182804 Aug 24 03:50:47.447228 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 593/1189] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:47 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:47.775809 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-3c64529f-316c-42b3-a470-5c018f11f427 req-4ae812c2-1de7-4e5e-b305-d0e739404bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d78a2e7-01d7-4ffa-b904-d675025f1b80", "name": "network-vif-plugged", "status": "completed", "tag": "1d91bcaf-1cff-4092-9346-e13ae001ab18"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:47.789390 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3c64529f-316c-42b3-a470-5c018f11f427 req-4ae812c2-1de7-4e5e-b305-d0e739404bc6 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.790149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3c64529f-316c-42b3-a470-5c018f11f427 req-4ae812c2-1de7-4e5e-b305-d0e739404bc6 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.790824 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-3c64529f-316c-42b3-a470-5c018f11f427 req-4ae812c2-1de7-4e5e-b305-d0e739404bc6 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.814805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-3c64529f-316c-42b3-a470-5c018f11f427 req-4ae812c2-1de7-4e5e-b305-d0e739404bc6 service nova] Creating event network-vif-plugged:1d91bcaf-1cff-4092-9346-e13ae001ab18 for instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 on hv-cinder-85426 Aug 24 03:50:47.823416 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-3c64529f-316c-42b3-a470-5c018f11f427 req-4ae812c2-1de7-4e5e-b305-d0e739404bc6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053127 Aug 24 03:50:47.824706 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 597/1190] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:48.471933 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:48.472589 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:48.478858 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:48.479371 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:48.480378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:48.481081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:48.481525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:48.482119 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:48.628995 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:48.638135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3bff652a-00c7-4ee4-8a26-72b7cfad4e91 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1319 microversion: 2.1 time: 0.170849 Aug 24 03:50:48.638754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 594/1191] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:48 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:49.664202 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:49.664954 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:49.669935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:49.670865 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:49.678126 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.678727 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.679164 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.679866 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.680320 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.680782 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.829089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:49.837166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c70c4951-86b3-4b5a-85e7-aacd54718170 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1507 microversion: 2.1 time: 0.175319 Aug 24 03:50:49.837756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 598/1192] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:49 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:49.860036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a620f2ae-8354-451a-8a06-054691ae74b7", "device": "/dev/sdb"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:49.862386 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:49.864702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:49.871424 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.871912 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.872442 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.873156 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.873610 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.874031 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.246319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-31ac0e91-fef8-4c0a-bd03-674751e5e90b tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "POST /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390555 Aug 24 03:50:50.247401 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 595/1193] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:50:49 2022] POST /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:03.586382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:03.590697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:03.594770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:03.596113 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=30 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:03.602883 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.603379 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.603830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.605143 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.605613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.606042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.637635 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3a1cb4bb-14ad-47dc-9d03-967eea54be50 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058013 Aug 24 03:51:03.638098 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 599/1194] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:51:03 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:51:03.701286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=16 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:03.702393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:03.706965 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:03.707564 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:03.715582 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.716070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.716537 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.717246 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.717703 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.718132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.745531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:51:03.828325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-137a30ad-5cf3-476a-950b-2f46c3e9fba9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 204 len: 0 microversion: 2.1 time: 0.128164 Aug 24 03:51:03.833078 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 596/1195] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:51:03 2022] DELETE /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:03.840478 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:03.841292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:03.850935 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.851778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.852289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.853129 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.853632 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.854281 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.015731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:04.024967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5800845a-7d66-480b-a74d-aca413d01ded tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1672 microversion: 2.1 time: 0.190112 Aug 24 03:51:04.025650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 600/1196] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:03 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1672 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:05.049249 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:05.049974 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:05.056708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.057199 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.057640 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.058990 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.059487 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.059918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.195176 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.203241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7fb7fb31-7d52-4886-9140-986027c90486 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1672 microversion: 2.1 time: 0.158270 Aug 24 03:51:05.203816 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 597/1197] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:05 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:06.224832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:06.225435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:06.232441 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.232939 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.233372 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.234089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.234680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.235103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.374169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.383161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4185b044-5686-4180-b569-565744cf5193 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1672 microversion: 2.1 time: 0.162091 Aug 24 03:51:06.383836 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 601/1198] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:06 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:07.405068 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:07.405756 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:07.412174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.412654 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.413092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.413951 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.414438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.414868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.559699 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:07.568300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-b35b4955-a78d-41e3-9cca-ee4d066f21a5 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1672 microversion: 2.1 time: 0.167095 Aug 24 03:51:07.568841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 598/1199] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:07 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:08.590103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:08.590750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:08.597487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.597986 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.598458 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.599167 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.599618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.600051 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.747362 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.755756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e447c818-5e87-4a21-9ec3-dd5202a3c909 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1672 microversion: 2.1 time: 0.169531 Aug 24 03:51:08.756324 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 602/1200] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:08 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:09.777380 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:09.777988 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:09.785471 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.786101 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.786567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.787351 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.787908 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.788336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.895718 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.903687 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7d4c50b1-8100-4b03-8435-0c6ec6f1afdf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 200 len: 1604 microversion: 2.1 time: 0.130147 Aug 24 03:51:09.904267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 599/1201] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:09 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 1604 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:09.983198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-fd410d36-94e7-4f05-a8d6-4305d727e635 req-a834c7e1-d9f6-4776-ab0c-8f4fcb331bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9453748-a38e-47eb-a18d-321371e80d31", "name": "network-vif-deleted", "tag": "eb86f147-1646-4029-8889-07eb61d9e986"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:09.994999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-fd410d36-94e7-4f05-a8d6-4305d727e635 req-a834c7e1-d9f6-4776-ab0c-8f4fcb331bed service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.995479 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-fd410d36-94e7-4f05-a8d6-4305d727e635 req-a834c7e1-d9f6-4776-ab0c-8f4fcb331bed service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.995917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-fd410d36-94e7-4f05-a8d6-4305d727e635 req-a834c7e1-d9f6-4776-ab0c-8f4fcb331bed service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.009614 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-fd410d36-94e7-4f05-a8d6-4305d727e635 req-a834c7e1-d9f6-4776-ab0c-8f4fcb331bed service nova] Creating event network-vif-deleted:eb86f147-1646-4029-8889-07eb61d9e986 for instance b9453748-a38e-47eb-a18d-321371e80d31 on hv-cinder-85426 Aug 24 03:51:10.015888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-fd410d36-94e7-4f05-a8d6-4305d727e635 req-a834c7e1-d9f6-4776-ab0c-8f4fcb331bed service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036905 Aug 24 03:51:10.017088 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 603/1202] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:10.925974 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.926619 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:10.933162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.933644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.934084 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.934820 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.935305 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.935737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.950025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] HTTP exception thrown: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Request method failure captured: Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 HTTP/1.1 Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ7i0DOHxNfsOYm53M-hIzViQqI2Dvsaze-0w967hGRFY1-SuYotuSecf5T4z5esPj4xwngzXH7tkZPEFccZzNhJabcPAcU-kqVAGmdyh5nnXq3NtSpFPXdS4niEcszq0xN0UAtiKPfRKowyYo7Rrve7OHf1-VuyQzSOzCPYUJhfrBg Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:51:10.952591 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_28b19b24989f449094001356712fc0e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/28b19b24989f449094001356712fc0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: fe0dc1ce495045e4bf158ec503a5b5d1 Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:51:10.954713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'b9453748-a38e-47eb-a18d-321371e80d31'} Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:51:10.956944 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:51:10.959118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:51:10.960713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Returning 404 to user: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:51:10.960713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e186608c-733a-45c3-aeea-9b3c9f377e04 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 404 len: 111 microversion: 2.1 time: 0.032170 Aug 24 03:51:10.960713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 600/1203] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:10 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:10.963628 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9d330e1e-95e9-4624-a92c-dea5cad58f63 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '.version_select at 0x7f077c1daee0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.969369 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d330e1e-95e9-4624-a92c-dea5cad58f63 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [1671b1a3-5bd2-4561-9593-52b7ac536df2] AMQP server on 10.222.0.91:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:51:11.976839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d330e1e-95e9-4624-a92c-dea5cad58f63 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [1671b1a3-5bd2-4561-9593-52b7ac536df2] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 53966. Aug 24 03:51:11.998085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9d330e1e-95e9-4624-a92c-dea5cad58f63 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-253236526" status: 202 len: 0 microversion: 2.1 time: 1.038468 Aug 24 03:51:11.999457 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 604/1204] 10.222.0.91 () {58 vars in 1218 bytes} [Wed Aug 24 03:51:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-253236526 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:51:12.648441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3d7a8819-567a-4272-9ada-d97a7db1dc2a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'create', calling method: .version_select at 0x7f077c1545e0>, body: {"keypair": {"name": "tempest-keypair-915395756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFypX9hxZTBSHfWGvx+olFL8utydl7xZP+i5YQ8RnTQ4Cmz8l/zKuWMlTECoheoofRB4tYd1E5rlAPhmId6YFaw+t1i+uYWhl4ijdq5kOm9/+0AJiBJFxK5DsK83KLJM7g=="}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:12.664586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-3d7a8819-567a-4272-9ada-d97a7db1dc2a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Getting quotas for project 28b19b24989f449094001356712fc0e0. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:12.668526 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-3d7a8819-567a-4272-9ada-d97a7db1dc2a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Getting quotas for user fe0dc1ce495045e4bf158ec503a5b5d1 and project 28b19b24989f449094001356712fc0e0. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:12.691837 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3d7a8819-567a-4272-9ada-d97a7db1dc2a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047220 Aug 24 03:51:12.692434 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 601/1205] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:51:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:12.871188 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.875800 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:12.895283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.895804 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.896245 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.896968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.897425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.897849 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.991499 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lazy-loading 'services' on Instance uuid 4d78a2e7-01d7-4ffa-b904-d675025f1b80 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:51:13.070428 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-28c6a0f9-7914-40ec-8485-0896d34b0b9e tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "DELETE /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80/os-volume_attachments/a620f2ae-8354-451a-8a06-054691ae74b7" status: 202 len: 0 microversion: 2.1 time: 0.207694 Aug 24 03:51:13.071115 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 605/1206] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:51:12 2022] DELETE /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80/os-volume_attachments/a620f2ae-8354-451a-8a06-054691ae74b7 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:51:13.990053 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-669269908", "imageRef": "1bd70d59-2f80-4465-8116-bae1fa281db3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f381488-2c35-4d4e-890e-cd2d9dbf6306"}], "security_groups": [{"name": "tempest-securitygroup--2137085219"}], "key_name": "tempest-keypair-915395756", "user_data": "}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:14.124263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.network.neutron [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] validate_networks() for [('3f381488-2c35-4d4e-890e-cd2d9dbf6306', None, None, None, None, None)] {{(pid=127260) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:14.214709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.215296 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.222676 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.223154 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.223584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.224275 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.224850 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.225266 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.255843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Going to try to terminate instance {{(pid=127259) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:51:14.351579 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-42a85d03-67dd-4f74-9bbc-13ad4f9d4185 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "DELETE /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 204 len: 0 microversion: 2.1 time: 0.142419 Aug 24 03:51:14.352571 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 606/1207] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:51:14 2022] DELETE /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:51:14.362823 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.363347 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.369601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.370090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.370559 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.371268 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.371725 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.372152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.543670 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.553819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-b135caaa-c3c8-4b8b-90e5-c5bfe09c5315 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1513 microversion: 2.1 time: 0.195922 Aug 24 03:51:14.555580 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 607/1208] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:14 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:14.698268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Flavor limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:14.698920 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Image limits 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:14.699534 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Flavor pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:14.699951 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Image pref 0:0:0 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:14.700363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.virt.hardware [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:14.710954 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.712248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.713020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.713768 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.714247 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.714677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.733685 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Getting quotas for project 28b19b24989f449094001356712fc0e0. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:14.739751 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Getting quotas for user fe0dc1ce495045e4bf158ec503a5b5d1 and project 28b19b24989f449094001356712fc0e0. Resources: {'ram', 'cores', 'instances'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:14.755019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Going to run 1 instances... {{(pid=127260) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:14.757634 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bd70d59-2f80-4465-8116-bae1fa281db3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:14.809886 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-41bd76a8-5988-47c6-8b68-b33b4fcc3c16 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.824456 Aug 24 03:51:14.810489 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 602/1209] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:51:14.821796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-406f6d3b-8a89-4fce-b73a-5c4a717f7ff9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.822699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-406f6d3b-8a89-4fce-b73a-5c4a717f7ff9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.881167 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-406f6d3b-8a89-4fce-b73a-5c4a717f7ff9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.888084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-406f6d3b-8a89-4fce-b73a-5c4a717f7ff9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1236 microversion: 2.1 time: 0.070148 Aug 24 03:51:14.888651 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 608/1210] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:14 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:15.579636 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:15.580245 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:15.587541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.588023 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.588484 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.589177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.589632 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.590059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.731743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:15.739669 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-3bb8a3d0-3aae-4d7a-88be-83876ee71696 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1513 microversion: 2.1 time: 0.163997 Aug 24 03:51:15.740241 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 603/1211] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:15 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:15.909336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ec9d4e2a-2e24-4f3e-9aaa-db85489141ae tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:15.909961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ec9d4e2a-2e24-4f3e-9aaa-db85489141ae tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:15.964072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-ec9d4e2a-2e24-4f3e-9aaa-db85489141ae tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:15.971503 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ec9d4e2a-2e24-4f3e-9aaa-db85489141ae tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1236 microversion: 2.1 time: 0.065971 Aug 24 03:51:15.972101 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 609/1212] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:15 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:16.760952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:16.761641 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:16.768108 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.768594 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.769072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.769785 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.770266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.770700 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.851643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec33f84fef94b56ab0e1639bb8f9b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b17dad9df1840cc816875bcc42f1706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.860126 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-62318402-9391-4b5c-a47d-a165034117d4 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 200 len: 1471 microversion: 2.1 time: 0.103058 Aug 24 03:51:16.860712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 604/1213] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:16 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 1471 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:16.899327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-f0aab6ca-db25-4fa4-aada-4ab1a67ca4c5 req-e3206989-be9c-47b7-8404-0aeb147bbada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d78a2e7-01d7-4ffa-b904-d675025f1b80", "name": "network-vif-deleted", "tag": "1d91bcaf-1cff-4092-9346-e13ae001ab18"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:16.910102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f0aab6ca-db25-4fa4-aada-4ab1a67ca4c5 req-e3206989-be9c-47b7-8404-0aeb147bbada service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.910756 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f0aab6ca-db25-4fa4-aada-4ab1a67ca4c5 req-e3206989-be9c-47b7-8404-0aeb147bbada service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.911025 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f0aab6ca-db25-4fa4-aada-4ab1a67ca4c5 req-e3206989-be9c-47b7-8404-0aeb147bbada service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.923489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-f0aab6ca-db25-4fa4-aada-4ab1a67ca4c5 req-e3206989-be9c-47b7-8404-0aeb147bbada service nova] Creating event network-vif-deleted:1d91bcaf-1cff-4092-9346-e13ae001ab18 for instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 on hv-cinder-85426 Aug 24 03:51:16.929854 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-f0aab6ca-db25-4fa4-aada-4ab1a67ca4c5 req-e3206989-be9c-47b7-8404-0aeb147bbada service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033991 Aug 24 03:51:16.930468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 610/1214] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:16.992812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1d895b0d-37ff-413e-945f-8cbe7346c71c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:16.993438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1d895b0d-37ff-413e-945f-8cbe7346c71c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:17.061982 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1d895b0d-37ff-413e-945f-8cbe7346c71c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.069733 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1d895b0d-37ff-413e-945f-8cbe7346c71c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1236 microversion: 2.1 time: 0.080942 Aug 24 03:51:17.070343 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 605/1215] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:16 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:17.881506 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:17.882325 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] [instance: 4d78a2e7-01d7-4ffa-b904-d675025f1b80] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:17.888382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.888891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.889323 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.890003 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.890473 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.890897 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.903770 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] HTTP exception thrown: Instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 could not be found. Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Request method failure captured: Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 HTTP/1.1 Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZ-iTabtBtrtc9K0ukr7f7px_4e8q8dWYzsxEQ5gYjOZiwh0WCV0zkZa27xXwwrBexU6yO0vco9XHZ0_VuwjpZKqst6fZ3xuJZtoRwRIXTehpTviAnWQ3ewmFc5w6MQwcq1YJKwnnrPba4Ihe_xMJ5o0Cv45v4lrR7ywC-O5X2DV2P0 Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 9b17dad9df1840cc816875bcc42f1706 Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-VolumesSnapshotTestJSON-551811160 Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:51:17.905889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_9b17dad9df1840cc816875bcc42f1706"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9b17dad9df1840cc816875bcc42f1706"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/9b17dad9df1840cc816875bcc42f1706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/9b17dad9df1840cc816875bcc42f1706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-VolumesSnapshotTestJSON-551811160 Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 9b17dad9df1840cc816875bcc42f1706 Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-551811160 Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-VolumesSnapshotTestJSON-551811160-project Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: bec33f84fef94b56ab0e1639bb8f9b14 Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-VolumesSnapshotTestJSON-551811160-project Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 could not be found. Aug 24 03:51:17.907647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '4d78a2e7-01d7-4ffa-b904-d675025f1b80'} Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 could not be found. Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:51:17.908700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 could not be found. Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 could not be found. Aug 24 03:51:17.910718 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:51:17.912240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] Returning 404 to user: Instance 4d78a2e7-01d7-4ffa-b904-d675025f1b80 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:51:17.912240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7d0fe928-5452-43bb-89ac-96bb1c143b40 tempest-VolumesSnapshotTestJSON-551811160 tempest-VolumesSnapshotTestJSON-551811160-project] 10.222.0.91 "GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80" status: 404 len: 111 microversion: 2.1 time: 0.030089 Aug 24 03:51:17.912240 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 611/1216] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:17 2022] GET /compute/v2.1/servers/4d78a2e7-01d7-4ffa-b904-d675025f1b80 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:18.091559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e973e60a-c927-424d-90fd-7ab2dabbbbe9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.092662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e973e60a-c927-424d-90fd-7ab2dabbbbe9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:18.151869 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e973e60a-c927-424d-90fd-7ab2dabbbbe9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.165747 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e973e60a-c927-424d-90fd-7ab2dabbbbe9 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1236 microversion: 2.1 time: 0.076344 Aug 24 03:51:18.178723 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 606/1217] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:19.187496 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:19.188140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:19.194590 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.195072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.195510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.196200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.196693 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.197371 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.261293 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.269788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5cff97b0-b8f5-415a-a73b-0ce3c15bd4aa tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1240 microversion: 2.1 time: 0.086628 Aug 24 03:51:19.271419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 612/1218] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:19 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:20.290477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.292096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.297485 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.297964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.298430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.299113 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.299559 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.299978 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.363029 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.370502 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ae1464a9-8691-48aa-ade4-87622613d270 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1296 microversion: 2.1 time: 0.083978 Aug 24 03:51:20.371052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 607/1219] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:21.391782 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:21.392348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:21.398719 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.399200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.399641 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.400327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.400780 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.401207 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.465465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.473661 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4d1eefd8-2efb-4991-9a87-3e9ad2c9734a tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1296 microversion: 2.1 time: 0.086377 Aug 24 03:51:21.474239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 613/1220] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:21 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:22.493932 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:22.494586 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:22.501851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.502399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.502832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.503519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.503963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.504385 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.565191 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:22.572978 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-639e68d8-b150-4b7a-b22b-0e46c4647886 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1296 microversion: 2.1 time: 0.082869 Aug 24 03:51:22.573535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 608/1221] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:22 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:23.594022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:23.594680 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:23.601359 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.601844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.602304 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.603192 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.603647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.604072 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.670477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.679284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-da177119-a403-4191-9e51-046cc43b1f4d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1294 microversion: 2.1 time: 0.089171 Aug 24 03:51:23.680063 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 614/1222] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:23 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:24.703895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:24.704513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:24.710737 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.711104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.711544 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.712430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.712885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.713317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.731193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:24.895353 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-7e976a03-844f-4a88-ab45-ca689f67b840 req-f88edc95-3601-4b52-a0da-050d2a9d0aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c64927-86c1-433a-b2f9-ad9c2fb72c47", "tag": "e8e78c04-c3ac-41a2-83a6-b6ac129c93a4"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:24.907062 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-7e976a03-844f-4a88-ab45-ca689f67b840 req-f88edc95-3601-4b52-a0da-050d2a9d0aa5 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.907818 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-7e976a03-844f-4a88-ab45-ca689f67b840 req-f88edc95-3601-4b52-a0da-050d2a9d0aa5 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.908583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-7e976a03-844f-4a88-ab45-ca689f67b840 req-f88edc95-3601-4b52-a0da-050d2a9d0aa5 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.921299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-7e976a03-844f-4a88-ab45-ca689f67b840 req-f88edc95-3601-4b52-a0da-050d2a9d0aa5 service nova] Creating event network-changed:e8e78c04-c3ac-41a2-83a6-b6ac129c93a4 for instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 on hv-cinder-85426 Aug 24 03:51:24.921513 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.929399 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-7e976a03-844f-4a88-ab45-ca689f67b840 req-f88edc95-3601-4b52-a0da-050d2a9d0aa5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037148 Aug 24 03:51:24.930177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-dab48b12-e62c-492e-a039-25e63a38b7af tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.230673 Aug 24 03:51:24.930678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 615/1223] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:24.930809 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 609/1224] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:24 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:25.952063 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:25.952761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:25.958999 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.959477 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.959913 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.960603 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.961060 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.961490 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.976576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=4 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:26.094885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.102299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3cb715df-6e9c-449a-97d6-cdf9ab464c7c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.154919 Aug 24 03:51:26.102863 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 616/1225] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:25 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:27.123801 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:27.124423 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:27.131301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.131795 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.132272 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.132980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.133438 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.133866 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.268791 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:27.276453 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-84033b2d-c94d-4252-bce2-01c94425aa2e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.157143 Aug 24 03:51:27.277024 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 610/1226] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:27 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:28.298043 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:28.298722 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:28.305121 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.305602 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.306038 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.306759 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.307214 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.307637 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.441312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.449305 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5fdc0033-e1c1-4df5-81de-373d37d26aea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.155088 Aug 24 03:51:28.449871 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 617/1227] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:28 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:29.470198 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.470819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.473096 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=14 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:29.478605 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.479095 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.479512 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.480199 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.480644 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.481063 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.757174 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.765514 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-13713530-16f3-4fa1-9d3e-0886688c1f4e tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.299119 Aug 24 03:51:29.766086 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 611/1228] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:30.786643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:30.787344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:30.793769 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.794447 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.794873 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.795576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.796037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.796467 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.925165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:30.928638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:30.933809 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c4de3f17-9a06-4468-bc47-e542a2737d35 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.151251 Aug 24 03:51:30.934420 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 618/1229] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:30 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:31.955017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:31.956073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:31.962832 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.963336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.963772 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.964456 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.964903 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.965325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.101946 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.110059 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ecea3328-524f-40f1-b68d-bf55afcb2d9c tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.158859 Aug 24 03:51:32.110813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 612/1230] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:31 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:33.131517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:33.132142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:33.140487 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.140947 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.141393 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.142099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.142591 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.143203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.327517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.335162 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-aa4fb9de-a134-4c3f-b543-e3b29e587ba4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.207529 Aug 24 03:51:33.335743 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 619/1231] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:33 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:34.355694 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:34.356220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:34.359170 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:34.364968 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.365445 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.365874 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.366579 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.367026 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.367444 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.371776 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:34.505319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:34.513073 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c3162a7b-cb87-4644-a25e-83db04744d61 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.161201 Aug 24 03:51:34.513613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 613/1232] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:34 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:34.873306 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-c8e31bed-5986-405d-9d19-8d00f627f927 req-229efa94-40d2-4436-981f-14bb2dd2664d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c64927-86c1-433a-b2f9-ad9c2fb72c47", "name": "network-vif-plugged", "status": "completed", "tag": "e8e78c04-c3ac-41a2-83a6-b6ac129c93a4"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:34.878679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:34.884900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-c8e31bed-5986-405d-9d19-8d00f627f927 req-229efa94-40d2-4436-981f-14bb2dd2664d service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.885377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-c8e31bed-5986-405d-9d19-8d00f627f927 req-229efa94-40d2-4436-981f-14bb2dd2664d service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.885888 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-c8e31bed-5986-405d-9d19-8d00f627f927 req-229efa94-40d2-4436-981f-14bb2dd2664d service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.900608 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-c8e31bed-5986-405d-9d19-8d00f627f927 req-229efa94-40d2-4436-981f-14bb2dd2664d service nova] Creating event network-vif-plugged:e8e78c04-c3ac-41a2-83a6-b6ac129c93a4 for instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 on hv-cinder-85426 Aug 24 03:51:34.905816 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-c8e31bed-5986-405d-9d19-8d00f627f927 req-229efa94-40d2-4436-981f-14bb2dd2664d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036848 Aug 24 03:51:34.906658 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 620/1233] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:35.533959 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:35.534574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:35.541100 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.541584 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.542021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.542748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.543204 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.543637 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.674959 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.682574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2edff6ea-bb8f-402b-89c0-266e5d8b00e4 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1362 microversion: 2.1 time: 0.152455 Aug 24 03:51:35.683142 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 614/1234] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:35 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:36.706835 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.707446 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.713476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.713948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.714492 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.715175 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.715623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.716111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.846085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.853786 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-cbd717f2-d82c-48bc-910f-92aea0689631 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1547 microversion: 2.1 time: 0.151966 Aug 24 03:51:36.854381 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 621/1235] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:36.875132 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.875696 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.881971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.882507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.882948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.883643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.884099 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.884524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.965390 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-92df8083-90cd-4396-9866-d00b7ea23fea tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094721 Aug 24 03:51:36.965982 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 615/1236] 10.222.0.91 () {58 vars in 1275 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:37.872685 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-fd5aadd5-3bac-4565-8fb0-274dc4c5a265 req-1f721ac5-4c35-4bfd-b8fb-f4bf9c7a92a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c64927-86c1-433a-b2f9-ad9c2fb72c47", "tag": "e8e78c04-c3ac-41a2-83a6-b6ac129c93a4"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:37.882436 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-fd5aadd5-3bac-4565-8fb0-274dc4c5a265 req-1f721ac5-4c35-4bfd-b8fb-f4bf9c7a92a0 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.882919 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-fd5aadd5-3bac-4565-8fb0-274dc4c5a265 req-1f721ac5-4c35-4bfd-b8fb-f4bf9c7a92a0 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.883349 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-fd5aadd5-3bac-4565-8fb0-274dc4c5a265 req-1f721ac5-4c35-4bfd-b8fb-f4bf9c7a92a0 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.895461 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-fd5aadd5-3bac-4565-8fb0-274dc4c5a265 req-1f721ac5-4c35-4bfd-b8fb-f4bf9c7a92a0 service nova] Creating event network-changed:e8e78c04-c3ac-41a2-83a6-b6ac129c93a4 for instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 on hv-cinder-85426 Aug 24 03:51:37.904433 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-fd5aadd5-3bac-4565-8fb0-274dc4c5a265 req-1f721ac5-4c35-4bfd-b8fb-f4bf9c7a92a0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034361 Aug 24 03:51:37.905522 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 622/1237] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:53.165850 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=5 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:53.167171 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=15 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:53.382515 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-68ef1c09-43c5-435c-8cac-316d24aded3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Action: 'create', calling method: .version_select at 0x7f077c1545e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1728595666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJeeKiS3gXs0iY2mXT/60SC26XDov+MApv8ozBHf5S1jNlwPP4H6nS+DLsE/FaUvwxtnYftu57ne+hwOZZiqpVwiivdVYZgnJuNmxF+xPQLztx07jjyQROl7iOTd2C5UQ=="}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:53.398985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-68ef1c09-43c5-435c-8cac-316d24aded3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Getting quotas for project 7b550db4de5841e8a1ffcc7213275499. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:53.404051 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.quota [None req-68ef1c09-43c5-435c-8cac-316d24aded3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Getting quotas for user 9c1f5f4c1e544708a69b5631af831dd0 and project 7b550db4de5841e8a1ffcc7213275499. Resources: {'key_pairs'} {{(pid=127260) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:53.427081 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-68ef1c09-43c5-435c-8cac-316d24aded3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.262619 Aug 24 03:51:53.427605 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 616/1238] 10.222.0.91 () {60 vars in 1159 bytes} [Wed Aug 24 03:51:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:18.275016 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=5 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:18.275829 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=16 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:18.280587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1266819325", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1728595666", "security_groups": [{"name": "tempest-secgroup-smoke-514472142"}], "block_device_mapping_v2": [{"uuid": "5b9b58ac-812d-416b-8764-6a9a83182433", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11498da5-ead6-4929-9a3c-cf14ffa67b94"}]}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:18.394911 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] validate_networks() for [('11498da5-ead6-4929-9a3c-cf14ffa67b94', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:18.784034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:18.784463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:18.785050 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:18.785465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:18.785889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:18.795777 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.796265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.796702 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.797443 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.797891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.798357 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.816283 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Getting quotas for project 7b550db4de5841e8a1ffcc7213275499. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:18.820540 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Getting quotas for user 9c1f5f4c1e544708a69b5631af831dd0 and project 7b550db4de5841e8a1ffcc7213275499. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:18.892683 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:18.895374 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b9b58ac-812d-416b-8764-6a9a83182433',volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:19.025326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8238150e-ecca-4227-abc2-2e1032d624a6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751980 Aug 24 03:52:19.025967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 623/1239] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:52:19.034148 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=4 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:19.034961 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:19.039449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-304525bc-77eb-4a86-9f56-7f1a95b4c58b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:19.040004 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-304525bc-77eb-4a86-9f56-7f1a95b4c58b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:19.099041 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-304525bc-77eb-4a86-9f56-7f1a95b4c58b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:19.109589 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-304525bc-77eb-4a86-9f56-7f1a95b4c58b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1095 microversion: 2.1 time: 0.076604 Aug 24 03:52:19.110707 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 617/1240] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:19 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:20.131887 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:20.132625 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:20.139531 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.140012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.140436 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.141131 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.141958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.141958 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.207774 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.216794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c61b04f2-e611-4b1d-9e40-757f17bc9f3c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1211 microversion: 2.1 time: 0.089241 Aug 24 03:52:20.217432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 624/1241] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:20 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:21.238147 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:21.238800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:21.246074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.246596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.247319 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.248025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.248481 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.248914 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.468090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:21.475848 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-252cc190-a857-4bed-a372-15734b8db480 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.241469 Aug 24 03:52:21.476427 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 618/1242] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:21 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:21.582954 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-f9a0e074-60b0-4330-91e1-250c21e1719d req-bc38c8ca-d079-41b7-a58e-4b57b1d07918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d35870-26f0-4e53-be24-8217bcd19bb9", "tag": "e550e77c-e208-4fa5-b92f-31b1544839a0"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:21.596915 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f9a0e074-60b0-4330-91e1-250c21e1719d req-bc38c8ca-d079-41b7-a58e-4b57b1d07918 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.597746 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f9a0e074-60b0-4330-91e1-250c21e1719d req-bc38c8ca-d079-41b7-a58e-4b57b1d07918 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.598212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f9a0e074-60b0-4330-91e1-250c21e1719d req-bc38c8ca-d079-41b7-a58e-4b57b1d07918 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.609601 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-f9a0e074-60b0-4330-91e1-250c21e1719d req-bc38c8ca-d079-41b7-a58e-4b57b1d07918 service nova] Creating event network-changed:e550e77c-e208-4fa5-b92f-31b1544839a0 for instance 06d35870-26f0-4e53-be24-8217bcd19bb9 on hv-cinder-85426 Aug 24 03:52:21.614654 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-f9a0e074-60b0-4330-91e1-250c21e1719d req-bc38c8ca-d079-41b7-a58e-4b57b1d07918 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036477 Aug 24 03:52:21.615239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 625/1243] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:22.496675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:22.497286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:22.503814 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:22.504294 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:22.504729 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:22.505421 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:22.505876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:22.506333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:22.634822 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:22.642895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-745e2b0d-a8ee-405c-83ee-167f1317d127 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.150087 Aug 24 03:52:22.643469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 619/1244] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:22 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:23.664344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:23.665073 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:23.672284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.672761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.673192 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.673875 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.674473 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.674788 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.810807 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:23.818401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c75b4460-9a03-4689-bade-72986eee1744 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.158175 Aug 24 03:52:23.818955 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 626/1245] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:23 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:24.840968 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:24.841576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:24.847541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.848030 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.848459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.849148 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.849596 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.850017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.982339 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:24.989887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-464ebae1-179f-4584-9ccd-47ceee929033 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.153550 Aug 24 03:52:24.990480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 620/1246] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:24 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:26.010790 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:26.011405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:26.017885 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.018412 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.018854 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.019544 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.019993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.020419 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.152521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.160087 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e131ad73-bb3e-4705-81e4-9ec3482b8bc2 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.153302 Aug 24 03:52:26.160635 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 627/1247] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:26 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:27.180952 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:27.181567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:27.188598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.189116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.189553 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.190270 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.190727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.191149 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.320824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.329061 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d4df9f62-b296-49e8-ab0a-c48761e93710 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.151980 Aug 24 03:52:27.329655 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 621/1248] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:27 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:28.350538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:28.351165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:28.358239 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.358715 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.359198 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.359820 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.360268 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.360692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.496202 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.503716 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-00bca159-5043-478f-bcaa-dac52be1df79 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.157136 Aug 24 03:52:28.504267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 628/1249] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:28 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:29.523675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:29.524239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:29.526675 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:29.532511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.533045 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.533473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.534253 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.534742 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.535172 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.672746 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:29.680501 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a7493d6a-86bc-44f8-ab84-f850e05b9022 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.160826 Aug 24 03:52:29.681066 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 622/1250] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:29 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:30.700988 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:30.701620 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:30.703561 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:30.704372 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:30.710702 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.711210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.711645 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.712331 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.712778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.713701 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.848406 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:30.856542 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4acedece-33d4-4700-9116-35b79647168a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.159342 Aug 24 03:52:30.857103 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 629/1251] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:30 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:31.876743 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:31.877333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:31.883841 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.884324 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.884819 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.885511 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.885967 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.886418 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.014925 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.022473 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-67047c2c-fe8f-4b7f-8af0-d48f019c2877 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.149677 Aug 24 03:52:32.023034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 623/1252] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:31 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.044899 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.045555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.052033 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.052566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.053110 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.053864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.054707 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.055140 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.059670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-83feaa9f-658b-46b2-b05e-6427fc159601 req-54a54436-c156-4fc5-8f8b-499fc8cd81c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d35870-26f0-4e53-be24-8217bcd19bb9", "name": "network-vif-plugged", "status": "completed", "tag": "e550e77c-e208-4fa5-b92f-31b1544839a0"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:33.071357 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-83feaa9f-658b-46b2-b05e-6427fc159601 req-54a54436-c156-4fc5-8f8b-499fc8cd81c6 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.071835 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-83feaa9f-658b-46b2-b05e-6427fc159601 req-54a54436-c156-4fc5-8f8b-499fc8cd81c6 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.072265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-83feaa9f-658b-46b2-b05e-6427fc159601 req-54a54436-c156-4fc5-8f8b-499fc8cd81c6 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.083627 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-83feaa9f-658b-46b2-b05e-6427fc159601 req-54a54436-c156-4fc5-8f8b-499fc8cd81c6 service nova] Creating event network-vif-plugged:e550e77c-e208-4fa5-b92f-31b1544839a0 for instance 06d35870-26f0-4e53-be24-8217bcd19bb9 on hv-cinder-85426 Aug 24 03:52:33.088756 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-83feaa9f-658b-46b2-b05e-6427fc159601 req-54a54436-c156-4fc5-8f8b-499fc8cd81c6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033358 Aug 24 03:52:33.089378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 624/1253] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:33.200165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.207795 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2dc32446-03f6-4552-ba3b-0f8c8a3f3686 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.168656 Aug 24 03:52:33.208344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 630/1254] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:34.229949 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.231175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.237318 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.237804 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.238273 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.239020 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.239477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.239905 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.619047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.626738 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a5a9d976-da90-4adb-bd69-b69fd1f767e0 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1266 microversion: 2.1 time: 0.401531 Aug 24 03:52:34.627297 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 625/1255] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:35.647471 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.648111 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.655105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.655584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.656023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.656710 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.657166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.657591 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.789547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.797838 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2f993b0e-00cc-4df2-b5db-fa113f302926 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1452 microversion: 2.1 time: 0.154278 Aug 24 03:52:35.798435 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 631/1256] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:35.817446 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.818092 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.824851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.825336 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.825777 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.826504 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.826965 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.827392 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.955868 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.964036 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-305a45a7-9e7e-4755-a58f-79965109fa22 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1452 microversion: 2.1 time: 0.150379 Aug 24 03:52:35.965074 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 626/1257] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:37.569353 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-40de4f10-23dc-4c1e-aaf0-7929c5a00807 req-711562aa-4ee3-4ba3-bc8e-39694ac9ed66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d35870-26f0-4e53-be24-8217bcd19bb9", "tag": "e550e77c-e208-4fa5-b92f-31b1544839a0"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:37.581368 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-40de4f10-23dc-4c1e-aaf0-7929c5a00807 req-711562aa-4ee3-4ba3-bc8e-39694ac9ed66 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.581919 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-40de4f10-23dc-4c1e-aaf0-7929c5a00807 req-711562aa-4ee3-4ba3-bc8e-39694ac9ed66 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.582372 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-40de4f10-23dc-4c1e-aaf0-7929c5a00807 req-711562aa-4ee3-4ba3-bc8e-39694ac9ed66 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.594202 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-40de4f10-23dc-4c1e-aaf0-7929c5a00807 req-711562aa-4ee3-4ba3-bc8e-39694ac9ed66 service nova] Creating event network-changed:e550e77c-e208-4fa5-b92f-31b1544839a0 for instance 06d35870-26f0-4e53-be24-8217bcd19bb9 on hv-cinder-85426 Aug 24 03:52:37.599400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-40de4f10-23dc-4c1e-aaf0-7929c5a00807 req-711562aa-4ee3-4ba3-bc8e-39694ac9ed66 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033947 Aug 24 03:52:37.600229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 632/1258] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:07.370218 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:07.370813 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.372879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=22 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:07.373551 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=50 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:07.379335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.379811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.380238 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.380922 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.381372 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.381787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.405393 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d62b6746-291d-40cf-982e-064f5c5bfe59 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/ips" status: 200 len: 144 microversion: 2.1 time: 0.039163 Aug 24 03:53:07.405948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 627/1259] 10.222.0.91 () {58 vars in 1248 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:08.724268 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:08.725173 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=48 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:08.729481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cc4bf12-2eb3-418c-ac91-6c6596e84a71"}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:08.731899 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:08.739070 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.739554 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.739997 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.740687 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.741145 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.741573 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.003689 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-47b0bf08-76dc-4268-822a-8970bdcd7707 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280800 Aug 24 03:53:09.004486 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 633/1260] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:53:08 2022] POST /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:16.530532 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:16.532704 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:16.539060 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.539535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.540595 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.541283 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.541998 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.542876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.572003 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-64d426b3-bb7c-4162-a822-28a8c5768b44 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045363 Aug 24 03:53:16.572556 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 628/1261] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:16 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:16.583657 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:16.584243 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:16.591642 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.592123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.592560 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.593254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.593709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.594137 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.623638 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bcc4d2da-9c59-4d3b-bff2-87e402bf7f54 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/0cc4bf12-2eb3-418c-ac91-6c6596e84a71" status: 200 len: 194 microversion: 2.1 time: 0.044283 Aug 24 03:53:16.624220 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 634/1262] 10.222.0.91 () {58 vars in 1413 bytes} [Wed Aug 24 03:53:16 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/0cc4bf12-2eb3-418c-ac91-6c6596e84a71 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:17.966078 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67c14ab4-09a8-4d6f-b0ec-473a525129d1"}} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:17.968444 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:17.975337 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.975826 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.976262 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.976956 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.978040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.978497 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.240790 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a1d75070-de99-47a6-aa30-1ac25520d3bd tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "POST /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278930 Aug 24 03:53:18.241721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 629/1263] 10.222.0.91 () {60 vars in 1323 bytes} [Wed Aug 24 03:53:17 2022] POST /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:25.755144 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:25.757376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:25.764557 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.765042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.765482 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.766176 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.766662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.767092 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.796405 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-20e2be0e-98a3-4ad4-84b5-ad318340b3da tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045134 Aug 24 03:53:25.796959 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 635/1264] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:25 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:25.940276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:25.940847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:25.947426 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.947904 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.948335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.949013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.949460 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.949874 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.978298 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4cf5c02c-d851-43a7-b2fd-aac687efd602 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/0cc4bf12-2eb3-418c-ac91-6c6596e84a71" status: 200 len: 194 microversion: 2.1 time: 0.042190 Aug 24 03:53:25.978895 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 630/1265] 10.222.0.91 () {58 vars in 1413 bytes} [Wed Aug 24 03:53:25 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/0cc4bf12-2eb3-418c-ac91-6c6596e84a71 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:25.989384 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:25.989869 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:25.996329 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.996812 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.997244 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.997932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.998406 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.998825 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.079534 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lazy-loading 'services' on Instance uuid 27c64927-86c1-433a-b2f9-ad9c2fb72c47 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:26.153913 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ca600753-cd70-46bb-b4ce-2cede5e87f9f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/0cc4bf12-2eb3-418c-ac91-6c6596e84a71" status: 202 len: 0 microversion: 2.1 time: 0.168247 Aug 24 03:53:26.154530 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 636/1266] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:53:25 2022] DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/0cc4bf12-2eb3-418c-ac91-6c6596e84a71 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:28.325325 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.325807 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.332409 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.332890 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.333331 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.334022 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.334509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.334937 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.363906 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1e11fc2f-c0b2-462c-95a5-35f20a82eccb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/67c14ab4-09a8-4d6f-b0ec-473a525129d1" status: 200 len: 194 microversion: 2.1 time: 0.042353 Aug 24 03:53:28.364411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 631/1267] 10.222.0.91 () {58 vars in 1413 bytes} [Wed Aug 24 03:53:28 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/67c14ab4-09a8-4d6f-b0ec-473a525129d1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:28.376583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.377161 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.383261 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.383768 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.384206 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.384892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.385375 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.385798 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.464571 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lazy-loading 'services' on Instance uuid 27c64927-86c1-433a-b2f9-ad9c2fb72c47 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:28.534712 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-7d73e4ee-7f26-45f9-8e84-3610348dfc96 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/67c14ab4-09a8-4d6f-b0ec-473a525129d1" status: 202 len: 0 microversion: 2.1 time: 0.162650 Aug 24 03:53:28.535284 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 637/1268] 10.222.0.91 () {58 vars in 1416 bytes} [Wed Aug 24 03:53:28 2022] DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments/67c14ab4-09a8-4d6f-b0ec-473a525129d1 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:29.701491 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:29.703782 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:29.711519 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.712003 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.712440 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.713135 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.713592 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.714019 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.742598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-30556885-0ea0-4c53-a542-c20ea3dfbd8b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044979 Aug 24 03:53:29.743723 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 632/1269] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:29 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:53:29.857567 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:29.860034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:29.866803 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.867290 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.867889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.869116 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.869579 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.870007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.899361 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bc2f807c-6dc7-48e9-a3f1-921d11f96c94 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047279 Aug 24 03:53:29.899831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 638/1270] 10.222.0.91 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:29 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:53:29.963826 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:29.964320 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:29.970134 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.970643 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.971075 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.971763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.972196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.972613 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.997728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:53:30.071721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-cfd63df5-6645-4a97-9cda-1177a414eb2d tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 204 len: 0 microversion: 2.1 time: 0.111472 Aug 24 03:53:30.072314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 633/1271] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:53:29 2022] DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:53:30.080336 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:30.080954 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:30.087398 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.087878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.088316 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.089035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.089463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.089894 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.221259 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:30.229052 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c9099f44-42b5-4f14-92f3-458a6e1f455b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1671 microversion: 2.1 time: 0.152493 Aug 24 03:53:30.229619 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 639/1272] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:30 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:31.250072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:31.250788 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:31.257125 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.257604 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.258034 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.259313 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.259757 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.260178 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.396021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:31.404625 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-042b0bf8-793e-47e9-9c3f-190254f5aa78 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1671 microversion: 2.1 time: 0.158455 Aug 24 03:53:31.404913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 634/1273] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:31 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:32.427037 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:32.427650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:32.434589 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.435074 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.435513 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.436212 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.436669 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.437097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.566521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:32.575274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-0944bf49-15c1-4634-80d0-825c8aa1d38f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1671 microversion: 2.1 time: 0.152010 Aug 24 03:53:32.575760 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 640/1274] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:32 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:33.374985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-32bd4428-8503-4d95-bc93-e3ea21c3c307 req-e676ffda-8096-4d30-a471-79057699eaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c64927-86c1-433a-b2f9-ad9c2fb72c47", "name": "network-vif-deleted", "tag": "e8e78c04-c3ac-41a2-83a6-b6ac129c93a4"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:33.386726 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-32bd4428-8503-4d95-bc93-e3ea21c3c307 req-e676ffda-8096-4d30-a471-79057699eaed service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.387489 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-32bd4428-8503-4d95-bc93-e3ea21c3c307 req-e676ffda-8096-4d30-a471-79057699eaed service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.387916 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-32bd4428-8503-4d95-bc93-e3ea21c3c307 req-e676ffda-8096-4d30-a471-79057699eaed service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.399836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-32bd4428-8503-4d95-bc93-e3ea21c3c307 req-e676ffda-8096-4d30-a471-79057699eaed service nova] Creating event network-vif-deleted:e8e78c04-c3ac-41a2-83a6-b6ac129c93a4 for instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 on hv-cinder-85426 Aug 24 03:53:33.405645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-32bd4428-8503-4d95-bc93-e3ea21c3c307 req-e676ffda-8096-4d30-a471-79057699eaed service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Aug 24 03:53:33.406477 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 635/1275] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:33.596200 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.596811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:33.604095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.604579 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.605012 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.605719 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.606170 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.606623 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.639819 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.640362 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.640775 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.641225 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lazy-loading 'fault' on Instance uuid 27c64927-86c1-433a-b2f9-ad9c2fb72c47 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:33.683323 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0dc1ce495045e4bf158ec503a5b5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b19b24989f449094001356712fc0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:33.691099 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-8fd639d9-3ce1-48ba-90d6-fca895cc1c91 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 200 len: 1326 microversion: 2.1 time: 0.098822 Aug 24 03:53:33.691670 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 641/1276] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:33 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:34.712212 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:34.712902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:34.719065 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.719541 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.719972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.720657 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.721103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.721525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.736759 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] HTTP exception thrown: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Request method failure captured: Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 HTTP/1.1 Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ7i0DOHxNfsOYm53M-hIzViQqI2Dvsaze-0w967hGRFY1-SuYotuSecf5T4z5esPj4xwngzXH7tkZPEFccZzNhJabcPAcU-kqVAGmdyh5nnXq3NtSpFPXdS4niEcszq0xN0UAtiKPfRKowyYo7Rrve7OHf1-VuyQzSOzCPYUJhfrBg Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:53:34.738398 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_28b19b24989f449094001356712fc0e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/28b19b24989f449094001356712fc0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: fe0dc1ce495045e4bf158ec503a5b5d1 Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:34.740353 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '27c64927-86c1-433a-b2f9-ad9c2fb72c47'} Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:34.741288 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:34.743399 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:34.744740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Returning 404 to user: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:34.744740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-526a201e-2667-4111-881b-968464c7de9b tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 404 len: 111 microversion: 2.1 time: 0.032256 Aug 24 03:53:34.744740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 636/1277] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:34 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:34.749123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-5eeb41e4-0abe-4b2e-addd-7af056e79836 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '.version_select at 0x7f077c23f8b0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:34.768837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-5eeb41e4-0abe-4b2e-addd-7af056e79836 tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-915395756" status: 202 len: 0 microversion: 2.1 time: 0.023373 Aug 24 03:53:34.769399 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 642/1278] 10.222.0.91 () {58 vars in 1218 bytes} [Wed Aug 24 03:53:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-915395756 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:36.236876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:53:36.237405 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 03:53:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:53:37.662248 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:37.662947 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:37.666740 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:37.670671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.671147 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.671576 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.672267 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.672713 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.673133 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.676603 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:37.689078 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] HTTP exception thrown: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Request method failure captured: Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 HTTP/1.1 Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ7i0DOHxNfsOYm53M-hIzViQqI2Dvsaze-0w967hGRFY1-SuYotuSecf5T4z5esPj4xwngzXH7tkZPEFccZzNhJabcPAcU-kqVAGmdyh5nnXq3NtSpFPXdS4niEcszq0xN0UAtiKPfRKowyYo7Rrve7OHf1-VuyQzSOzCPYUJhfrBg Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:53:37.690730 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_28b19b24989f449094001356712fc0e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/28b19b24989f449094001356712fc0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: fe0dc1ce495045e4bf158ec503a5b5d1 Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.692787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '27c64927-86c1-433a-b2f9-ad9c2fb72c47'} Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:37.693964 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.695410 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.697242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Returning 404 to user: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:37.697242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9712389e-0178-46d7-8b71-aedb6a269beb tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 404 len: 111 microversion: 2.1 time: 0.038768 Aug 24 03:53:37.697242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 637/1279] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:53:37 2022] DELETE /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:37.702590 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:37.703210 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: 27c64927-86c1-433a-b2f9-ad9c2fb72c47] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:37.709974 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.710495 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.710936 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.712142 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.712602 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.713033 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.727407 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] HTTP exception thrown: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Request method failure captured: Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 HTTP/1.1 Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZ7i0DOHxNfsOYm53M-hIzViQqI2Dvsaze-0w967hGRFY1-SuYotuSecf5T4z5esPj4xwngzXH7tkZPEFccZzNhJabcPAcU-kqVAGmdyh5nnXq3NtSpFPXdS4niEcszq0xN0UAtiKPfRKowyYo7Rrve7OHf1-VuyQzSOzCPYUJhfrBg Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:53:37.729085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_28b19b24989f449094001356712fc0e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/28b19b24989f449094001356712fc0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: fe0dc1ce495045e4bf158ec503a5b5d1 Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.730830 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '27c64927-86c1-433a-b2f9-ad9c2fb72c47'} Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:37.731692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. Aug 24 03:53:37.733007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:37.734299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Returning 404 to user: Instance 27c64927-86c1-433a-b2f9-ad9c2fb72c47 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:37.734299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-dcd8e24e-2e52-4452-9860-58c20bc6066f tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47" status: 404 len: 111 microversion: 2.1 time: 0.032623 Aug 24 03:53:37.734299 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 643/1280] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:37 2022] GET /compute/v2.1/servers/27c64927-86c1-433a-b2f9-ad9c2fb72c47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:38.888277 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.888872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.898693 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.899568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.901055 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.902378 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.903244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.904041 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.919965 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] HTTP exception thrown: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Request method failure captured: Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: DELETE /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 HTTP/1.1 Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBZ7i0DOHxNfsOYm53M-hIzViQqI2Dvsaze-0w967hGRFY1-SuYotuSecf5T4z5esPj4xwngzXH7tkZPEFccZzNhJabcPAcU-kqVAGmdyh5nnXq3NtSpFPXdS4niEcszq0xN0UAtiKPfRKowyYo7Rrve7OHf1-VuyQzSOzCPYUJhfrBg Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:53:38.921500 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_28b19b24989f449094001356712fc0e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/28b19b24989f449094001356712fc0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: fe0dc1ce495045e4bf158ec503a5b5d1 Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.923200 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'b9453748-a38e-47eb-a18d-321371e80d31'} Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:38.924071 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.925525 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.926948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Returning 404 to user: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:38.926948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-446fae01-84c9-46f6-988f-4637b7a5b2cf tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 404 len: 111 microversion: 2.1 time: 0.039411 Aug 24 03:53:38.926948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 638/1281] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:53:38 2022] DELETE /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:38.931464 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.932108 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] [instance: b9453748-a38e-47eb-a18d-321371e80d31] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.934516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:38.939877 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.940360 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.940797 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.941520 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.941973 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.942714 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.950515 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:38.960403 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] HTTP exception thrown: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Request method failure captured: Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 HTTP/1.1 Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBZ7i0DOHxNfsOYm53M-hIzViQqI2Dvsaze-0w967hGRFY1-SuYotuSecf5T4z5esPj4xwngzXH7tkZPEFccZzNhJabcPAcU-kqVAGmdyh5nnXq3NtSpFPXdS4niEcszq0xN0UAtiKPfRKowyYo7Rrve7OHf1-VuyQzSOzCPYUJhfrBg Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 03:53:38.962146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_28b19b24989f449094001356712fc0e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/28b19b24989f449094001356712fc0e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/28b19b24989f449094001356712fc0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 28b19b24989f449094001356712fc0e0 Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870074603 Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: fe0dc1ce495045e4bf158ec503a5b5d1 Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-AttachVolumeTestJSON-870074603-project Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.964541 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': 'b9453748-a38e-47eb-a18d-321371e80d31'} Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:38.965385 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. Aug 24 03:53:38.966833 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 03:53:38.968060 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] Returning 404 to user: Instance b9453748-a38e-47eb-a18d-321371e80d31 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:38.968060 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-ba34969f-d5a0-4724-bcd5-8859ba6150ee tempest-AttachVolumeTestJSON-870074603 tempest-AttachVolumeTestJSON-870074603-project] 10.222.0.91 "GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31" status: 404 len: 111 microversion: 2.1 time: 0.036617 Aug 24 03:53:38.968060 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 644/1282] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:38 2022] GET /compute/v2.1/servers/b9453748-a38e-47eb-a18d-321371e80d31 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:04.399016 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:04.399755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:04.403900 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:04.404396 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:04.411701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.412182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.412617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.413308 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.413767 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.414210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.440509 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:04.517163 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-43e63e70-2839-4f88-b2a2-3887a8a29a34 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "DELETE /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 204 len: 0 microversion: 2.1 time: 0.119668 Aug 24 03:55:04.517779 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 639/1283] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:04 2022] DELETE /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:04.525055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=1 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:04.529624 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:04.530270 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:04.538205 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.538705 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.539139 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.539839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.540292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.540720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.674342 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.682001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-85c673b7-3c61-42d1-96de-c83a4c87e30c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1576 microversion: 2.1 time: 0.159099 Aug 24 03:55:04.682662 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 645/1284] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:04 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:05.705040 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:05.706312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.712842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.713317 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.713744 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.714456 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.714902 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.715322 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.855724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:05.864148 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ece3b47b-66a2-47a5-a5fd-c1c4c1e1024c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1576 microversion: 2.1 time: 0.163268 Aug 24 03:55:05.874728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 640/1285] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:05 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:06.885039 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.885686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.893054 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.893497 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.893943 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.894678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.895321 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.895753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.038996 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:07.047227 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-874f3fc4-8a0b-4b06-bee9-b0f3a5bce566 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1576 microversion: 2.1 time: 0.166061 Aug 24 03:55:07.047801 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 646/1286] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:07.698368 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-e429f823-fde3-4a9c-9cbf-22164bcda1ed req-1fc21c6c-1d33-4488-86dc-65be221abef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d35870-26f0-4e53-be24-8217bcd19bb9", "name": "network-vif-deleted", "tag": "e550e77c-e208-4fa5-b92f-31b1544839a0"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:07.710105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e429f823-fde3-4a9c-9cbf-22164bcda1ed req-1fc21c6c-1d33-4488-86dc-65be221abef3 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.710703 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e429f823-fde3-4a9c-9cbf-22164bcda1ed req-1fc21c6c-1d33-4488-86dc-65be221abef3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.711242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-e429f823-fde3-4a9c-9cbf-22164bcda1ed req-1fc21c6c-1d33-4488-86dc-65be221abef3 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.724510 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-e429f823-fde3-4a9c-9cbf-22164bcda1ed req-1fc21c6c-1d33-4488-86dc-65be221abef3 service nova] Creating event network-vif-deleted:e550e77c-e208-4fa5-b92f-31b1544839a0 for instance 06d35870-26f0-4e53-be24-8217bcd19bb9 on hv-cinder-85426 Aug 24 03:55:07.730642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-e429f823-fde3-4a9c-9cbf-22164bcda1ed req-1fc21c6c-1d33-4488-86dc-65be221abef3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035867 Aug 24 03:55:07.732072 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 641/1287] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:07.864035 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:55:07.864531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 03:55:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:55:08.070177 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.071643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.078262 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.078845 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.079402 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.080102 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.080864 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.081327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.115993 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.116750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.117432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.118073 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.objects.instance [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lazy-loading 'fault' on Instance uuid 06d35870-26f0-4e53-be24-8217bcd19bb9 {{(pid=127259) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:08.160450 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:08.168219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4b1b7714-d945-4f87-86e2-243af4de2299 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 200 len: 1231 microversion: 2.1 time: 0.102211 Aug 24 03:55:08.168780 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 647/1288] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:09.190531 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.191503 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.197651 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.198129 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.198597 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.199274 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.199719 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.200136 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.213044 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] HTTP exception thrown: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Request method failure captured: Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 HTTP/1.1 Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBaBU-XZ2269PD0CcBczGZpnFtctHCNhIhra7J66RWUe1yEWyXvDqFbruw2nVBGWZaH640-19-zrIyDjR5xdMOH68K65nsh9IS98LQhR0JwDb3fr6-wouBZaBBv7NRj7tBAo61LfZToCM2oLXJMvA4RFm9RjZ_KxB4lCZFi0WBHqJxk0 Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 03:55:09.214661 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-TestVolumeBootPattern-896280571 Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-TestVolumeBootPattern-896280571-project Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 9c1f5f4c1e544708a69b5631af831dd0 Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-TestVolumeBootPattern-896280571-project Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 03:55:09.216482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '06d35870-26f0-4e53-be24-8217bcd19bb9'} Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:09.217571 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 03:55:09.219314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 03:55:09.220855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Returning 404 to user: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:09.220855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-a0b7bcd5-c761-4a75-a71f-ded0d02910c5 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 404 len: 111 microversion: 2.1 time: 0.030116 Aug 24 03:55:09.220855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 642/1289] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:09.310516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1473765083", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1728595666", "security_groups": [{"name": "tempest-secgroup-smoke-514472142"}], "block_device_mapping_v2": [{"uuid": "5b9b58ac-812d-416b-8764-6a9a83182433", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11498da5-ead6-4929-9a3c-cf14ffa67b94"}]}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:09.419615 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] validate_networks() for [('11498da5-ead6-4929-9a3c-cf14ffa67b94', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:55:09.784313 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:55:09.785607 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:55:09.786127 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:55:09.786576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:55:09.786997 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:55:09.795828 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.796312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.796749 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.797474 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.797932 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.798391 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.814970 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Getting quotas for project 7b550db4de5841e8a1ffcc7213275499. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:09.819427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Getting quotas for user 9c1f5f4c1e544708a69b5631af831dd0 and project 7b550db4de5841e8a1ffcc7213275499. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:09.875106 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:55:09.877183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b9b58ac-812d-416b-8764-6a9a83182433',volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:55:10.001000 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR oslo.messaging._drivers.impl_rabbit [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [b6c40145-f84a-4bc8-b225-d30495d7534e] AMQP server on 10.222.0.91:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:55:11.009288 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [b6c40145-f84a-4bc8-b225-d30495d7534e] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 55454. Aug 24 03:55:11.013076 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-14bc1d33-f264-462a-be9e-f48b193619e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.706483 Aug 24 03:55:11.013724 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 648/1290] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:55:11.024956 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5a00f1a9-7eee-4601-bc94-cbce8c43c9a8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.025574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5a00f1a9-7eee-4601-bc94-cbce8c43c9a8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.082765 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-5a00f1a9-7eee-4601-bc94-cbce8c43c9a8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.090273 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5a00f1a9-7eee-4601-bc94-cbce8c43c9a8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1095 microversion: 2.1 time: 0.069030 Aug 24 03:55:11.090825 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 643/1291] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:11 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:12.111918 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.113424 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:12.120036 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.120546 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.121001 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.121702 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.122152 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.122610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.192791 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:12.201894 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4c199313-5844-4beb-96ee-8fcb8e6b9754 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1201 microversion: 2.1 time: 0.094223 Aug 24 03:55:12.202587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 649/1292] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:12 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:13.223057 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.223702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.230863 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.231441 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.231972 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.232953 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.233507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.233999 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.444645 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.455535 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-fd699ba2-9ab9-42e4-a370-1ffbb093e61c tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.236461 Aug 24 03:55:13.456470 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 644/1293] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:13.627191 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-21f692ab-ee3d-493e-bd69-c385aeb524f1 req-d770490a-a15d-4f62-969e-79968ae3c156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871bb2d7-4672-4bbb-80c2-10859580702c", "tag": "50678b6d-01e6-40b7-ab25-cfbc3ad66ed9"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:13.637566 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-21f692ab-ee3d-493e-bd69-c385aeb524f1 req-d770490a-a15d-4f62-969e-79968ae3c156 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.638149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-21f692ab-ee3d-493e-bd69-c385aeb524f1 req-d770490a-a15d-4f62-969e-79968ae3c156 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.638678 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-21f692ab-ee3d-493e-bd69-c385aeb524f1 req-d770490a-a15d-4f62-969e-79968ae3c156 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.650288 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-21f692ab-ee3d-493e-bd69-c385aeb524f1 req-d770490a-a15d-4f62-969e-79968ae3c156 service nova] Creating event network-changed:50678b6d-01e6-40b7-ab25-cfbc3ad66ed9 for instance 871bb2d7-4672-4bbb-80c2-10859580702c on hv-cinder-85426 Aug 24 03:55:13.655333 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-21f692ab-ee3d-493e-bd69-c385aeb524f1 req-d770490a-a15d-4f62-969e-79968ae3c156 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032016 Aug 24 03:55:13.655921 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 650/1294] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:14.476064 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.476676 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.483196 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.483670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.484104 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.484789 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.485239 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.485664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.614722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.622300 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-dace0e58-f22e-4892-b605-09789572a3bf tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.150199 Aug 24 03:55:14.622847 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 645/1295] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:15.644613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.645423 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.651824 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.652426 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.652757 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.653463 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.653920 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.654376 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.802217 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.809948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a7e28b62-42e3-419c-958c-9e971d43d164 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.170156 Aug 24 03:55:15.810547 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 651/1296] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:16.830811 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.831430 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.837833 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.838348 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.838787 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.839476 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.839934 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.840388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.977388 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.985162 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-38bdf784-f430-41df-8721-780392a8181d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.158221 Aug 24 03:55:16.985722 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 646/1297] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:16 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:18.005900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.006469 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:18.012778 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.013253 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.013692 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.014397 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.014846 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.015264 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.146997 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:18.154585 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-c51f86b1-b43b-4dc9-ba3e-056c8e24f41e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.152545 Aug 24 03:55:18.155147 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 652/1298] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:18 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:19.175629 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:19.176274 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:19.182650 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.183137 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.183582 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.184271 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.184726 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.185152 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.321659 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:19.330277 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-92ba50e2-d177-462c-8c74-6c9e821b540f tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.158963 Aug 24 03:55:19.330876 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 647/1299] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:19 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:20.352157 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:20.352761 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:20.355211 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:20.355858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:20.362285 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.362771 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.363384 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.364084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:20.364537 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:20.364967 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.498694 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:20.506630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-6d1dae96-64d6-4f4b-8ed1-7b71114a44bd tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.158351 Aug 24 03:55:20.507203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 653/1300] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:20 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:21.526963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:21.527612 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:21.529929 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:21.535411 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.535899 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.536334 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.537026 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:21.537483 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:21.537936 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:21.669784 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:21.677315 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ecc395cb-d35f-4269-b8c0-5446060ca131 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.154202 Aug 24 03:55:21.677879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 648/1301] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:21 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:22.702434 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:22.703059 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.709401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.709878 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.710340 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.711022 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.711470 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.711893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.839671 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.847290 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-4677469f-962a-401c-ba44-d6f72a0affcb tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.148757 Aug 24 03:55:22.847844 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 654/1302] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:22 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:23.868642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.869258 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.875674 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.876159 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.876602 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.877292 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.877749 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.878177 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.005265 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.012918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-1ca604fb-9611-4cb3-a4d0-ed9c5c200cb8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.148222 Aug 24 03:55:24.013488 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 649/1303] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:23 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:25.033303 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:25.033908 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:25.040892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.041372 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.041811 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.042555 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.043009 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.043436 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.174225 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.181892 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a5071ffa-107a-4532-8801-72754f631e59 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.152628 Aug 24 03:55:25.182486 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 655/1304] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:25 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:26.202887 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:26.203521 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:26.210363 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.210851 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.211295 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.211988 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.212445 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.212872 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.343508 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.351273 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-7aed9122-6975-43f0-a0f9-e77c159bc69e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.152154 Aug 24 03:55:26.351878 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 650/1305] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:26 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:27.372150 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.372695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.379105 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.379594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.380029 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.380723 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.381183 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.381613 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.513568 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:27.522056 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-016e422f-e5f0-4f13-81c9-3ff573b57f6b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.153852 Aug 24 03:55:27.522655 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 656/1306] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:28.542301 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:28.542935 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:28.549276 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.549755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.550724 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.551407 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.551858 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.552280 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.684042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:28.692566 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e5bc63d4-78cd-4a7b-8cc0-94eb588117c3 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.154014 Aug 24 03:55:28.693125 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 651/1307] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:28 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:29.713298 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:29.713914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.720355 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.720837 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.721274 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.722158 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.722647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.723085 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.851799 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.859919 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-218cd3e5-7c6e-40d2-8472-96d24a03ad65 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.150486 Aug 24 03:55:29.860481 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 657/1308] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:29 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:30.880314 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:30.880926 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:30.887433 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.887913 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.888349 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.889033 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.889486 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.889911 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.020098 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.027755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-994ea3d3-ed9f-4807-b2f0-3327922d390d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.151986 Aug 24 03:55:31.028312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 652/1309] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:30 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:32.048377 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:32.048971 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.056167 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.056643 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.057073 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.057755 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.058250 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.058673 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.193344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:32.201056 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1820e608-3057-4f41-8977-74d835cea0be tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.156570 Aug 24 03:55:32.201619 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 658/1310] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:32 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:33.222402 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.223017 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.229578 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.230062 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.230536 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.231228 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.231783 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.232225 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.369022 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.377452 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-ed7c9d47-eb15-4fb3-a8bb-8bc7004a99f8 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.158863 Aug 24 03:55:33.379235 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 653/1311] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:34.053647 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-f36ff61c-e60b-45a6-a5a9-2bd0bac27176 req-86f6ef27-0500-438f-9c0d-6c6bf26db569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871bb2d7-4672-4bbb-80c2-10859580702c", "name": "network-vif-plugged", "status": "completed", "tag": "50678b6d-01e6-40b7-ab25-cfbc3ad66ed9"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:34.063411 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f36ff61c-e60b-45a6-a5a9-2bd0bac27176 req-86f6ef27-0500-438f-9c0d-6c6bf26db569 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.063891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f36ff61c-e60b-45a6-a5a9-2bd0bac27176 req-86f6ef27-0500-438f-9c0d-6c6bf26db569 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.064322 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f36ff61c-e60b-45a6-a5a9-2bd0bac27176 req-86f6ef27-0500-438f-9c0d-6c6bf26db569 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.078146 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-f36ff61c-e60b-45a6-a5a9-2bd0bac27176 req-86f6ef27-0500-438f-9c0d-6c6bf26db569 service nova] Creating event network-vif-plugged:50678b6d-01e6-40b7-ab25-cfbc3ad66ed9 for instance 871bb2d7-4672-4bbb-80c2-10859580702c on hv-cinder-85426 Aug 24 03:55:34.083330 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-f36ff61c-e60b-45a6-a5a9-2bd0bac27176 req-86f6ef27-0500-438f-9c0d-6c6bf26db569 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164950 Aug 24 03:55:34.083914 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 659/1312] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:34.399824 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:34.400472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:34.407082 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.407568 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.408008 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.408701 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.409160 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.409585 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.414304 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.548885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.557175 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-4b574115-1da7-444f-9e6c-88069471b3b1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.161908 Aug 24 03:55:34.557739 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 654/1313] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:34 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:35.579178 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.579873 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.581781 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:35.588556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.589035 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.589476 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.590166 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.590630 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.591047 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.594750 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=82 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:35.781968 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.791023 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-afb4cd1d-6803-42d7-87c8-3496267fcb89 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1266 microversion: 2.1 time: 0.216447 Aug 24 03:55:35.791595 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 660/1314] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:36.812855 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:36.813472 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:36.816103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:36.822232 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.822723 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.823190 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.823883 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.824335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.824763 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.956703 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:36.965698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-53382db4-b3c0-406a-b21e-d7fe98900999 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1452 microversion: 2.1 time: 0.156653 Aug 24 03:55:36.966286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 655/1315] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:36 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:36.985265 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:36.985879 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:36.992928 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.993410 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.993851 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.994576 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.995034 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.995464 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.130401 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:37.137998 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2f1cd1b3-4ef5-483a-91cf-0ab2c25e9906 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1452 microversion: 2.1 time: 0.156596 Aug 24 03:55:37.138588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 661/1316] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:36 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:39.145976 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-c89f2e15-92fd-4a1f-93df-06516b0f8f09 req-fcf30943-fa65-4410-97c5-7309ced111dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871bb2d7-4672-4bbb-80c2-10859580702c", "tag": "50678b6d-01e6-40b7-ab25-cfbc3ad66ed9"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:39.155754 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c89f2e15-92fd-4a1f-93df-06516b0f8f09 req-fcf30943-fa65-4410-97c5-7309ced111dd service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.156242 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c89f2e15-92fd-4a1f-93df-06516b0f8f09 req-fcf30943-fa65-4410-97c5-7309ced111dd service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.158574 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-c89f2e15-92fd-4a1f-93df-06516b0f8f09 req-fcf30943-fa65-4410-97c5-7309ced111dd service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.168193 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-c89f2e15-92fd-4a1f-93df-06516b0f8f09 req-fcf30943-fa65-4410-97c5-7309ced111dd service nova] Creating event network-changed:50678b6d-01e6-40b7-ab25-cfbc3ad66ed9 for instance 871bb2d7-4672-4bbb-80c2-10859580702c on hv-cinder-85426 Aug 24 03:55:39.173252 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-c89f2e15-92fd-4a1f-93df-06516b0f8f09 req-fcf30943-fa65-4410-97c5-7309ced111dd service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237980 Aug 24 03:55:39.173852 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 656/1317] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:43.809891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:56:43.810470 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 03:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:56:56.245425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:56:56.246076 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 03:56:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:57:39.148584 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a0741b5-4d06-4fbf-897f-b987349fe2c0] AMQP server on 10.222.0.91:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 03:57:39.149382 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:39.150165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=11 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:39.154133 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1469600454", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1728595666", "security_groups": [{"name": "tempest-secgroup-smoke-514472142"}], "block_device_mapping_v2": [{"uuid": "985c6617-c860-4e8c-8f78-fc4c1ca92fbc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11498da5-ead6-4929-9a3c-cf14ffa67b94"}]}} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:39.324722 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.network.neutron [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] validate_networks() for [('11498da5-ead6-4929-9a3c-cf14ffa67b94', None, None, None, None, None)] {{(pid=127259) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:57:39.806409 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Flavor limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:57:39.806831 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Image limits 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:57:39.807900 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Flavor pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:57:39.808380 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Image pref 0:0:0 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:57:39.808795 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.virt.hardware [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127259) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:57:39.817903 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.818427 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.818862 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.819587 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:39.820042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:39.820526 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:39.837109 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Getting quotas for project 7b550db4de5841e8a1ffcc7213275499. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:57:39.841073 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.quota [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Getting quotas for user 9c1f5f4c1e544708a69b5631af831dd0 and project 7b550db4de5841e8a1ffcc7213275499. Resources: {'ram', 'cores', 'instances'} {{(pid=127259) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:57:39.899281 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Going to run 1 instances... {{(pid=127259) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:57:39.901893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='985c6617-c860-4e8c-8f78-fc4c1ca92fbc',volume_size=None,volume_type=None)] {{(pid=127259) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:57:40.031719 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-40231c75-1b6a-4950-af23-6094e782d0d7 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.884819 Aug 24 03:57:40.032353 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 662/1318] 10.222.0.91 () {60 vars in 1147 bytes} [Wed Aug 24 03:57:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:57:40.043836 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f07e29aa-3157-430f-8aac-1d8b71b420f1] AMQP server on 10.222.0.91:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 03:57:40.044617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=3 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:40.045455 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=13 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:40.052734 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-45a334be-131d-4f4b-8c11-ede18feedb2d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:40.053443 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-45a334be-131d-4f4b-8c11-ede18feedb2d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:40.170617 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-45a334be-131d-4f4b-8c11-ede18feedb2d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:40.181404 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-45a334be-131d-4f4b-8c11-ede18feedb2d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1095 microversion: 2.1 time: 0.141863 Aug 24 03:57:40.181983 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 657/1319] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:40 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1095 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:41.203578 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:41.204195 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:41.211610 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.212086 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.212516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.213215 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:41.213699 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:41.214114 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:41.219203 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a0741b5-4d06-4fbf-897f-b987349fe2c0] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 55736. Aug 24 03:57:41.279709 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:41.287832 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a36057b4-17bd-41b9-bec2-388ddafcced9 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1211 microversion: 2.1 time: 0.089420 Aug 24 03:57:41.288843 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 663/1320] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:41 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:42.309385 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:42.310025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:42.320679 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] [f07e29aa-3157-430f-8aac-1d8b71b420f1] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 55742. Aug 24 03:57:42.325601 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.326090 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.326560 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.327263 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.327720 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.328150 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.517449 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:42.525334 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e4f9f0ad-7c83-40f2-8647-25988c41f8e6 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.220283 Aug 24 03:57:42.526021 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 658/1321] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:42 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:42.621650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-88d2a5db-e086-4bfe-9597-4bca09860e2f req-50a47b20-ac3e-4c30-947f-0558c60dc219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce36a1d4-f4e0-467c-8470-03988366e3c7", "tag": "0679737d-b918-44b2-8105-7538f936a4d7"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:42.631077 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-88d2a5db-e086-4bfe-9597-4bca09860e2f req-50a47b20-ac3e-4c30-947f-0558c60dc219 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:42.631553 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-88d2a5db-e086-4bfe-9597-4bca09860e2f req-50a47b20-ac3e-4c30-947f-0558c60dc219 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:42.631985 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-88d2a5db-e086-4bfe-9597-4bca09860e2f req-50a47b20-ac3e-4c30-947f-0558c60dc219 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:42.642757 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-88d2a5db-e086-4bfe-9597-4bca09860e2f req-50a47b20-ac3e-4c30-947f-0558c60dc219 service nova] Creating event network-changed:0679737d-b918-44b2-8105-7538f936a4d7 for instance ce36a1d4-f4e0-467c-8470-03988366e3c7 on hv-cinder-85426 Aug 24 03:57:42.647599 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-88d2a5db-e086-4bfe-9597-4bca09860e2f req-50a47b20-ac3e-4c30-947f-0558c60dc219 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094155 Aug 24 03:57:42.648359 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 664/1322] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:43.546878 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:43.547493 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:43.554458 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:43.554943 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:43.555381 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.556084 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:43.556538 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:43.556963 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:43.691670 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:43.700205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6fbfe7fa-8e6a-459b-a340-3e4d78d7dd9d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.157293 Aug 24 03:57:43.700781 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 659/1323] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:43 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:44.721605 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:44.722353 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:44.728468 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.728945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.730004 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.730728 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:44.731179 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:44.731598 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:44.859809 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:44.867697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-01b0cb1a-d3ad-4c1f-88a1-ef6187357f6a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.150774 Aug 24 03:57:44.868254 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 665/1324] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:44 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:45.888004 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:45.888615 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:45.895025 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:45.895510 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:45.895948 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:45.896631 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:45.897084 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:45.897507 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:46.025642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:46.035767 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-e17adcdf-b8f3-41c4-a4f2-0d7fa376921e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.150738 Aug 24 03:57:46.035767 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 660/1325] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:45 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:47.056097 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:47.056720 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:47.063805 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:47.064292 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:47.064731 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.065676 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:47.066133 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:47.066593 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:47.200168 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:47.207684 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-35530bd1-2aab-4d69-b6bb-e5fafd11187d tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.155498 Aug 24 03:57:47.208248 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 666/1326] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:47 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:48.227052 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:48.227668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:48.234720 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:48.235202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:48.235638 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:48.236326 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:48.236781 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:48.237202 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:48.368831 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:48.376480 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-71176e21-b541-4cef-b439-d365ae0f0005 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.153306 Aug 24 03:57:48.377069 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 661/1327] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:48 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:49.396700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:49.397342 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:49.403941 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.404425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.404865 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.405581 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:49.406124 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:49.406510 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:49.535545 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:49.543121 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-1b5b76af-7d8d-46d7-b534-f955769b0dfc tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.150275 Aug 24 03:57:49.544181 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 667/1328] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:49 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:50.565046 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:50.565668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:50.568045 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell0:SELECT=2 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:50.573786 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.574302 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.575335 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.576037 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:50.576494 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:50.576924 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:50.708708 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:50.716445 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-d20cda17-7f6f-4981-945d-204a5562e36e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.155467 Aug 24 03:57:50.717001 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 662/1329] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:50 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:51.736535 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:51.737169 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:51.739125 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=2 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:51.739794 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell0:SELECT=6 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:51.746055 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.747222 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.747659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:51.748348 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:51.748802 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:51.749224 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:51.878588 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:51.886165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3f6c6a67-d716-427f-a005-16cde69e1161 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.153560 Aug 24 03:57:51.886774 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 668/1330] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:51 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:52.909660 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:52.910316 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:52.916769 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:52.917255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:52.917698 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:52.919103 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:52.919611 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:52.920038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:53.053013 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:53.060628 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-6d10e846-45a3-4033-8e67-faefe86c3a62 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.154808 Aug 24 03:57:53.061190 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 663/1331] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:52 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:54.081429 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:54.082014 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:54.088484 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.088989 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.089415 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.090749 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.091209 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.091631 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.224815 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:54.232514 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-bb4edd1f-f771-42fa-b64c-9f6285bd2b7a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.154884 Aug 24 03:57:54.233080 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 669/1332] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:54 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:54.792182 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-7219a8d1-9841-4235-9141-2a0dd05506b9 req-3f2927f7-e9f8-4bf2-b819-674fd2d25bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce36a1d4-f4e0-467c-8470-03988366e3c7", "name": "network-vif-plugged", "status": "completed", "tag": "0679737d-b918-44b2-8105-7538f936a4d7"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:54.803050 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-7219a8d1-9841-4235-9141-2a0dd05506b9 req-3f2927f7-e9f8-4bf2-b819-674fd2d25bce service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:54.803524 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-7219a8d1-9841-4235-9141-2a0dd05506b9 req-3f2927f7-e9f8-4bf2-b819-674fd2d25bce service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:54.803970 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-7219a8d1-9841-4235-9141-2a0dd05506b9 req-3f2927f7-e9f8-4bf2-b819-674fd2d25bce service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:54.816122 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-7219a8d1-9841-4235-9141-2a0dd05506b9 req-3f2927f7-e9f8-4bf2-b819-674fd2d25bce service nova] Creating event network-vif-plugged:0679737d-b918-44b2-8105-7538f936a4d7 for instance ce36a1d4-f4e0-467c-8470-03988366e3c7 on hv-cinder-85426 Aug 24 03:57:54.821153 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-7219a8d1-9841-4235-9141-2a0dd05506b9 req-3f2927f7-e9f8-4bf2-b819-674fd2d25bce service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Aug 24 03:57:54.821808 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 664/1333] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:55.253327 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:55.253917 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:55.260312 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.260793 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.261289 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.261976 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:55.262457 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:55.262889 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:55.389592 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:55.397521 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-3a0688c4-385d-4ea6-8cd3-42945d0aca09 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.148032 Aug 24 03:57:55.398095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 670/1334] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:55 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:56.419338 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:56.420026 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:56.426099 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.426683 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.427118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.427812 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:56.428255 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:56.428681 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:56.565592 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:56.574114 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-38b4092b-3afc-4b65-b35f-882360346ac4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1266 microversion: 2.1 time: 0.159379 Aug 24 03:57:56.575101 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 665/1335] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:56 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:57.596508 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:57.597344 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:57.603769 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:57.604249 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:57.604686 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:57.605373 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:57.605826 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:57.606286 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:57.738907 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.746854 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-fee4b6c8-ba14-4690-b974-0839ea4f9246 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1453 microversion: 2.1 time: 0.154327 Aug 24 03:57:57.747413 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 671/1336] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:57 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:57.766879 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:57.767677 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:57.774210 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:57.774706 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:57.775145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:57.775834 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:57.776290 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:57.776716 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:57.905769 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:57.913409 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9b78cbd1-3efc-4707-a5c8-4e757d962e7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1453 microversion: 2.1 time: 0.150314 Aug 24 03:57:57.913980 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 666/1337] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:57 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:59.806263 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-bc379596-1c2e-4651-8955-82c7d31dca8d req-49d950fe-229d-4413-8d1f-5206ff8d73e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce36a1d4-f4e0-467c-8470-03988366e3c7", "tag": "0679737d-b918-44b2-8105-7538f936a4d7"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:59.816021 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-bc379596-1c2e-4651-8955-82c7d31dca8d req-49d950fe-229d-4413-8d1f-5206ff8d73e2 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:59.816570 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-bc379596-1c2e-4651-8955-82c7d31dca8d req-49d950fe-229d-4413-8d1f-5206ff8d73e2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:59.817069 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-bc379596-1c2e-4651-8955-82c7d31dca8d req-49d950fe-229d-4413-8d1f-5206ff8d73e2 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:59.829502 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-bc379596-1c2e-4651-8955-82c7d31dca8d req-49d950fe-229d-4413-8d1f-5206ff8d73e2 service nova] Creating event network-changed:0679737d-b918-44b2-8105-7538f936a4d7 for instance ce36a1d4-f4e0-467c-8470-03988366e3c7 on hv-cinder-85426 Aug 24 03:57:59.834966 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-bc379596-1c2e-4651-8955-82c7d31dca8d req-49d950fe-229d-4413-8d1f-5206ff8d73e2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Aug 24 03:57:59.835933 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 672/1338] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:27.874662 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:58:27.875220 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 03:58:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:00:02.952445 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_api:SELECT=22 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:02.953439 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG dbcounter [-] [127260] Writing DB stats nova_cell1:SELECT=50 {{(pid=127260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:02.955650 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:02.956518 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG dbcounter [-] [127259] Writing DB stats nova_cell1:SELECT=54 {{(pid=127259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:02.958653 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:02.959205 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:02.961741 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [req-f961be67-a330-4086-a047-78ca7fa0267b req-00833f91-391f-4aea-97a8-23feea6b6afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce36a1d4-f4e0-467c-8470-03988366e3c7", "tag": "0679737d-b918-44b2-8105-7538f936a4d7"}]} {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:02.966971 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:02.967458 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:02.967892 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:02.968590 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:02.969042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:02.969469 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:02.973697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f961be67-a330-4086-a047-78ca7fa0267b req-00833f91-391f-4aea-97a8-23feea6b6afe service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:02.973697 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f961be67-a330-4086-a047-78ca7fa0267b req-00833f91-391f-4aea-97a8-23feea6b6afe service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:02.973974 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [req-f961be67-a330-4086-a047-78ca7fa0267b req-00833f91-391f-4aea-97a8-23feea6b6afe service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:02.986992 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.compute.server_external_events [req-f961be67-a330-4086-a047-78ca7fa0267b req-00833f91-391f-4aea-97a8-23feea6b6afe service nova] Creating event network-changed:0679737d-b918-44b2-8105-7538f936a4d7 for instance ce36a1d4-f4e0-467c-8470-03988366e3c7 on hv-cinder-85426 Aug 24 04:00:02.994700 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [req-f961be67-a330-4086-a047-78ca7fa0267b req-00833f91-391f-4aea-97a8-23feea6b6afe service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041284 Aug 24 04:00:02.995827 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 673/1339] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:03.003609 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Going to try to terminate instance {{(pid=127260) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:00:03.099727 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-25c1b8fb-4c31-4f17-a9a3-bd36e79f5ed1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 204 len: 0 microversion: 2.1 time: 0.148839 Aug 24 04:00:03.105478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 667/1340] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:02 2022] DELETE /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:03.112757 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:03.114042 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:03.121659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:03.122149 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:03.122617 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:03.123326 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:03.123782 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:03.124232 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:03.261633 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:03.269549 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-e0104531-6d50-43b2-bd41-9dc38b36f81e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1578 microversion: 2.1 time: 0.162459 Aug 24 04:00:03.270124 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 674/1341] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:03 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:03.818839 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:00:03.819084 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 04:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:00:04.291714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:04.292333 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:04.298800 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:04.299286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:04.299728 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:04.300425 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:04.301482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:04.301918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:04.500038 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:04.508106 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-2e4efd27-4c53-48cb-986a-8b7fbadabe7b tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1578 microversion: 2.1 time: 0.220739 Aug 24 04:00:04.508671 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 668/1342] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:04 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1578 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:05.529015 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:05.529629 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:05.536425 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.536961 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.537400 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.538089 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.538583 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.539007 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.558286 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-be8bc0e0-85b7-43f2-8dec-ea4f867606f4 req-c84174fc-e0a6-4c88-85e5-1c8e189bb5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce36a1d4-f4e0-467c-8470-03988366e3c7", "name": "network-vif-deleted", "tag": "0679737d-b918-44b2-8105-7538f936a4d7"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:05.568938 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-be8bc0e0-85b7-43f2-8dec-ea4f867606f4 req-c84174fc-e0a6-4c88-85e5-1c8e189bb5de service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:05.569416 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-be8bc0e0-85b7-43f2-8dec-ea4f867606f4 req-c84174fc-e0a6-4c88-85e5-1c8e189bb5de service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:05.569849 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-be8bc0e0-85b7-43f2-8dec-ea4f867606f4 req-c84174fc-e0a6-4c88-85e5-1c8e189bb5de service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:05.581985 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-be8bc0e0-85b7-43f2-8dec-ea4f867606f4 req-c84174fc-e0a6-4c88-85e5-1c8e189bb5de service nova] Creating event network-vif-deleted:0679737d-b918-44b2-8105-7538f936a4d7 for instance ce36a1d4-f4e0-467c-8470-03988366e3c7 on hv-cinder-85426 Aug 24 04:00:05.587918 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-be8bc0e0-85b7-43f2-8dec-ea4f867606f4 req-c84174fc-e0a6-4c88-85e5-1c8e189bb5de service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033111 Aug 24 04:00:05.588748 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 669/1343] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:00:05.608090 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:05.616677 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-298600c3-fa12-477c-bc64-3f24dc951442 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 200 len: 1392 microversion: 2.1 time: 0.091588 Aug 24 04:00:05.617256 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 675/1344] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:05 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 1392 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:06.638127 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:06.638775 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: ce36a1d4-f4e0-467c-8470-03988366e3c7] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:06.644990 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:06.645474 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:06.645923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:06.646642 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:06.647105 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:06.647533 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:06.661128 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] HTTP exception thrown: Instance ce36a1d4-f4e0-467c-8470-03988366e3c7 could not be found. Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Request method failure captured: Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 HTTP/1.1 Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBaBU-XZ2269PD0CcBczGZpnFtctHCNhIhra7J66RWUe1yEWyXvDqFbruw2nVBGWZaH640-19-zrIyDjR5xdMOH68K65nsh9IS98LQhR0JwDb3fr6-wouBZaBBv7NRj7tBAo61LfZToCM2oLXJMvA4RFm9RjZ_KxB4lCZFi0WBHqJxk0 Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 04:00:06.662844 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-TestVolumeBootPattern-896280571-project Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 9c1f5f4c1e544708a69b5631af831dd0 Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-TestVolumeBootPattern-896280571-project Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance ce36a1d4-f4e0-467c-8470-03988366e3c7 could not be found. Aug 24 04:00:06.664702 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': 'ce36a1d4-f4e0-467c-8470-03988366e3c7'} Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce36a1d4-f4e0-467c-8470-03988366e3c7 could not be found. Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:06.665731 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce36a1d4-f4e0-467c-8470-03988366e3c7 could not be found. Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce36a1d4-f4e0-467c-8470-03988366e3c7 could not be found. Aug 24 04:00:06.667557 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:06.669116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Returning 404 to user: Instance ce36a1d4-f4e0-467c-8470-03988366e3c7 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:06.669116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-5dc7c61d-51cb-439d-ad6c-a967061749b4 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7" status: 404 len: 111 microversion: 2.1 time: 0.030945 Aug 24 04:00:06.669116 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 670/1345] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:06 2022] GET /compute/v2.1/servers/ce36a1d4-f4e0-467c-8470-03988366e3c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:09.704579 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:09.705095 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:09.712594 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.713104 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.713538 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.713668 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-09fdb1d2-c364-4e1e-a84c-8182d2e78c08 req-147ee4c6-6879-491b-899c-c7b54b5bed24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871bb2d7-4672-4bbb-80c2-10859580702c", "tag": "50678b6d-01e6-40b7-ab25-cfbc3ad66ed9"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:09.714251 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.714703 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.715122 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.723401 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-09fdb1d2-c364-4e1e-a84c-8182d2e78c08 req-147ee4c6-6879-491b-899c-c7b54b5bed24 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.723880 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-09fdb1d2-c364-4e1e-a84c-8182d2e78c08 req-147ee4c6-6879-491b-899c-c7b54b5bed24 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.724310 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-09fdb1d2-c364-4e1e-a84c-8182d2e78c08 req-147ee4c6-6879-491b-899c-c7b54b5bed24 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.737859 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-09fdb1d2-c364-4e1e-a84c-8182d2e78c08 req-147ee4c6-6879-491b-899c-c7b54b5bed24 service nova] Creating event network-changed:50678b6d-01e6-40b7-ab25-cfbc3ad66ed9 for instance 871bb2d7-4672-4bbb-80c2-10859580702c on hv-cinder-85426 Aug 24 04:00:09.742559 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Going to try to terminate instance {{(pid=127259) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:00:09.743689 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-09fdb1d2-c364-4e1e-a84c-8182d2e78c08 req-147ee4c6-6879-491b-899c-c7b54b5bed24 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033499 Aug 24 04:00:09.744755 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 671/1346] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:09.825432 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-966c3720-35b3-4d7c-a85a-6fbcfedaee49 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "DELETE /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 204 len: 0 microversion: 2.1 time: 0.123682 Aug 24 04:00:09.825893 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 676/1347] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:09 2022] DELETE /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:09.835614 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:09.836328 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:09.842597 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.843299 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.844244 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.845138 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:09.845598 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:09.846251 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:09.980842 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.policy [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127260) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:09.988749 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-9f87e6ad-0e42-44dc-8a82-b95f41772631 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1577 microversion: 2.1 time: 0.157911 Aug 24 04:00:09.989825 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 672/1348] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:09 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:11.012465 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:11.013184 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:11.019695 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.020219 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.022123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.022123 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:11.022461 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:11.022824 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:11.160136 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:11.167994 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-a7e511cb-468d-4151-b93c-5d5502868706 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1577 microversion: 2.1 time: 0.160673 Aug 24 04:00:11.168556 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 677/1349] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:11 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:12.131575 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [req-35eccaa8-4c53-4004-b22d-cb884d808962 req-07d8d0c2-b25f-49d0-8434-b5d21ee53e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871bb2d7-4672-4bbb-80c2-10859580702c", "name": "network-vif-deleted", "tag": "50678b6d-01e6-40b7-ab25-cfbc3ad66ed9"}]} {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:12.141856 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-35eccaa8-4c53-4004-b22d-cb884d808962 req-07d8d0c2-b25f-49d0-8434-b5d21ee53e07 service nova] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:12.142312 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-35eccaa8-4c53-4004-b22d-cb884d808962 req-07d8d0c2-b25f-49d0-8434-b5d21ee53e07 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:12.142712 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [req-35eccaa8-4c53-4004-b22d-cb884d808962 req-07d8d0c2-b25f-49d0-8434-b5d21ee53e07 service nova] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:12.155145 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.compute.server_external_events [req-35eccaa8-4c53-4004-b22d-cb884d808962 req-07d8d0c2-b25f-49d0-8434-b5d21ee53e07 service nova] Creating event network-vif-deleted:50678b6d-01e6-40b7-ab25-cfbc3ad66ed9 for instance 871bb2d7-4672-4bbb-80c2-10859580702c on hv-cinder-85426 Aug 24 04:00:12.161478 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [req-35eccaa8-4c53-4004-b22d-cb884d808962 req-07d8d0c2-b25f-49d0-8434-b5d21ee53e07 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033394 Aug 24 04:00:12.162664 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 673/1350] 10.222.0.91 () {64 vars in 1317 bytes} [Wed Aug 24 04:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:12.188813 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:12.189628 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:12.197858 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:12.198454 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:12.199267 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:12.200038 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:12.200675 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:12.201229 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:12.268424 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.policy [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1f5f4c1e544708a69b5631af831dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b550db4de5841e8a1ffcc7213275499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127259) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:12.276516 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-2ae7e0f0-cc6f-4cfa-8bbe-4b8a49b41e3e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 200 len: 1226 microversion: 2.1 time: 0.091519 Aug 24 04:00:12.277351 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 678/1351] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:12 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:13.298119 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:13.298848 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 871bb2d7-4672-4bbb-80c2-10859580702c] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:13.305749 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:13.306266 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:13.306709 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:13.307397 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:13.307853 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:13.308277 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:13.321459 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] HTTP exception thrown: Instance 871bb2d7-4672-4bbb-80c2-10859580702c could not be found. Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Request method failure captured: Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c HTTP/1.1 Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBaBU-XZ2269PD0CcBczGZpnFtctHCNhIhra7J66RWUe1yEWyXvDqFbruw2nVBGWZaH640-19-zrIyDjR5xdMOH68K65nsh9IS98LQhR0JwDb3fr6-wouBZaBBv7NRj7tBAo61LfZToCM2oLXJMvA4RFm9RjZ_KxB4lCZFi0WBHqJxk0 Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 04:00:13.323089 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-TestVolumeBootPattern-896280571-project Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 9c1f5f4c1e544708a69b5631af831dd0 Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-TestVolumeBootPattern-896280571-project Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 871bb2d7-4672-4bbb-80c2-10859580702c could not be found. Aug 24 04:00:13.324815 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '871bb2d7-4672-4bbb-80c2-10859580702c'} Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871bb2d7-4672-4bbb-80c2-10859580702c could not be found. Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:13.325923 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871bb2d7-4672-4bbb-80c2-10859580702c could not be found. Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871bb2d7-4672-4bbb-80c2-10859580702c could not be found. Aug 24 04:00:13.327567 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:13.329028 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Returning 404 to user: Instance 871bb2d7-4672-4bbb-80c2-10859580702c could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:13.329028 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-c99b6854-0b62-45ae-9e9a-a731079e84f1 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c" status: 404 len: 111 microversion: 2.1 time: 0.030710 Aug 24 04:00:13.329028 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 674/1352] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:13 2022] GET /compute/v2.1/servers/871bb2d7-4672-4bbb-80c2-10859580702c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:14.019452 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:14.019976 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.compute.api [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127259) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:14.027045 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.027517 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.027948 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.028624 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.029071 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.029489 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG oslo_concurrency.lockutils [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.042231 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.wsgi [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] HTTP exception thrown: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Request method failure captured: Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: request: DELETE /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 HTTP/1.1 Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept: application/json Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Accept-Encoding: identity Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Connection: close Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Length: 0 Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Content-Type: application/json Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Host: 10.222.0.91 Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Openstack-System-Scope: None Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Auth-Token: gAAAAABjBaBU-XZ2269PD0CcBczGZpnFtctHCNhIhra7J66RWUe1yEWyXvDqFbruw2nVBGWZaH640-19-zrIyDjR5xdMOH68K65nsh9IS98LQhR0JwDb3fr6-wouBZaBBv7NRj7tBAo61LfZToCM2oLXJMvA4RFm9RjZ_KxB4lCZFi0WBHqJxk0 Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Id: None Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Domain-Name: None Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Identity-Status: Confirmed Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Is-Admin-Project: True Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Id: default Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Domain-Name: Default Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Project-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Role: reader,member Aug 24 04:00:14.043945 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Roles: reader,member Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-Tenant-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User: tempest-TestVolumeBootPattern-896280571-project Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Id: default Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Domain-Name: Default Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Id: 9c1f5f4c1e544708a69b5631af831dd0 Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: X-User-Name: tempest-TestVolumeBootPattern-896280571-project Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: method: > Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: exception: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.045730 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: action_args: {'id': '06d35870-26f0-4e53-be24-8217bcd19bb9'} Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:14.046753 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.048165 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.049659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Returning 404 to user: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. {{(pid=127259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:14.049659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-9ee808b0-167a-4d10-95ff-dfff0bd0f609 tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "DELETE /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 404 len: 111 microversion: 2.1 time: 0.029875 Aug 24 04:00:14.049659 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 679/1353] 10.222.0.91 () {58 vars in 1239 bytes} [Wed Aug 24 04:00:14 2022] DELETE /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:14.054070 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '>' {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:14.054714 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.compute.api [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] [instance: 06d35870-26f0-4e53-be24-8217bcd19bb9] Fetching instance by UUID {{(pid=127260) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:14.060577 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.061047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.061482 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.061707 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:00:14.061891 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 04:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:00:14.062161 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Acquiring lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:14.062721 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:14.063143 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG oslo_concurrency.lockutils [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Lock "b8a7a57e-d52d-44b0-8338-b5be28221a4a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:14.077166 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.wsgi [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] HTTP exception thrown: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Request method failure captured: Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: request: GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 HTTP/1.1 Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept: application/json Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Accept-Encoding: identity Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Connection: close Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Length: 0 Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Content-Type: application/json Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Host: 10.222.0.91 Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Openstack-System-Scope: None Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: User-Agent: python-urllib3/1.26.11 Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Auth-Token: gAAAAABjBaBU-XZ2269PD0CcBczGZpnFtctHCNhIhra7J66RWUe1yEWyXvDqFbruw2nVBGWZaH640-19-zrIyDjR5xdMOH68K65nsh9IS98LQhR0JwDb3fr6-wouBZaBBv7NRj7tBAo61LfZToCM2oLXJMvA4RFm9RjZ_KxB4lCZFi0WBHqJxk0 Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Id: None Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Domain-Name: None Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Identity-Status: Confirmed Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Is-Admin-Project: True Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Id: default Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Domain-Name: Default Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Project-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Role: reader,member Aug 24 04:00:14.078735 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Roles: reader,member Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.91:8080", "publicURL": "http://10.222.0.91:8080/v1/AUTH_7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/volume/v3/7b550db4de5841e8a1ffcc7213275499"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.91/compute/v2.1"}]}] Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Id: 7b550db4de5841e8a1ffcc7213275499 Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-Tenant-Name: tempest-TestVolumeBootPattern-896280571 Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User: tempest-TestVolumeBootPattern-896280571-project Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Id: default Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Domain-Name: Default Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Id: 9c1f5f4c1e544708a69b5631af831dd0 Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: X-User-Name: tempest-TestVolumeBootPattern-896280571-project Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: method: > Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: exception: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.080549 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: action_args: {'id': '06d35870-26f0-4e53-be24-8217bcd19bb9'} Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: {{(pid=127260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:00:14.082009 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. Aug 24 04:00:14.084118 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: ERROR nova.api.openstack.wsgi Aug 24 04:00:14.085395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: DEBUG nova.api.openstack.wsgi [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Returning 404 to user: Instance 06d35870-26f0-4e53-be24-8217bcd19bb9 could not be found. {{(pid=127260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:00:14.085395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO nova.api.openstack.requestlog [None req-74a64037-f975-45eb-ad35-8ec4e0ddb79e tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9" status: 404 len: 111 microversion: 2.1 time: 0.029777 Aug 24 04:00:14.085395 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: [pid: 127260|app: 0|req: 675/1354] 10.222.0.91 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:14 2022] GET /compute/v2.1/servers/06d35870-26f0-4e53-be24-8217bcd19bb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:00:15.379913 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: DEBUG nova.api.openstack.wsgi [None req-d9764988-e625-4a28-b797-8b422f4c5e1a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] Calling method '.version_select at 0x7f077c437dc0>' {{(pid=127259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:15.404188 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO nova.api.openstack.requestlog [None req-d9764988-e625-4a28-b797-8b422f4c5e1a tempest-TestVolumeBootPattern-896280571 tempest-TestVolumeBootPattern-896280571-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1728595666" status: 202 len: 0 microversion: 2.1 time: 0.028143 Aug 24 04:00:15.404796 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: [pid: 127259|app: 0|req: 680/1355] 10.222.0.91 () {58 vars in 1263 bytes} [Wed Aug 24 04:00:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1728595666 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:00:16.253917 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:00:16.254542 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 04:00:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:01:47.883231 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:01:47.884195 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 04:01:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:02:17.367047 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:02:17.367849 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 04:02:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:02:19.760618 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:02:19.761235 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 04:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:03:23.827976 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:03:23.829309 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 04:03:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:03:34.070910 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:03:34.071543 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 04:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:03:36.263885 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:03:36.264419 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 04:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:05:07.893268 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:05:07.894110 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 04:05:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:05:37.379042 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:05:37.380094 dv-cinder-854262-1-iscsi devstack@n-api.service[127260]: Wed Aug 24 04:05:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:05:39.772046 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:05:39.772679 dv-cinder-854262-1-iscsi devstack@n-api.service[127259]: Wed Aug 24 04:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!